[ 522.484445] env[66746]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 522.484445] env[66746]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 523.531018] env[66834]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 523.531018] env[66834]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 525.124893] env[66834]: INFO neutron.common.config [-] Logging enabled! [ 525.125330] env[66834]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b2.dev20 [ 525.125398] env[66834]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=66834) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 525.125678] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 525.125773] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 525.126640] env[66834]: WARNING oslo_policy.policy [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 525.126850] env[66834]: WARNING oslo_policy.policy [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 525.128547] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] VMware NSXv3 Agent initialized successfully. [ 525.128893] env[66834]: DEBUG oslo_concurrency.lockutils [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] Acquiring lock "singleton_lock" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.129030] env[66834]: DEBUG oslo_concurrency.lockutils [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] Acquired lock "singleton_lock" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.129236] env[66834]: DEBUG oslo_concurrency.lockutils [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] Releasing lock "singleton_lock" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.129516] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] Full set of CONF: {{(pid=66834) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 525.129624] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ******************************************************************************** {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 525.129723] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] Configuration options gathered from: {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 525.130090] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 525.130261] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 525.130365] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ================================================================================ {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 525.130530] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] agent_down_time = 75 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.130664] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] allow_automatic_dhcp_failover = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.130794] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] allow_bulk = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.130930] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] api_extensions_path = {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.131078] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] api_paste_config = api-paste.ini {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.131217] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] auth_strategy = keystone {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.131310] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] backdoor_port = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.131406] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] backdoor_socket = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.131538] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] backlog = 4096 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.131670] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] base_mac = fa:16:3e:00:00:00 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.131822] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] bind_host = 0.0.0.0 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.131955] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] bind_port = 9696 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.132099] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] client_socket_timeout = 900 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.132233] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] config_dir = [] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.132338] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.132470] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] config_source = [] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.132603] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] control_exchange = neutron {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.132735] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] core_plugin = ml2 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.132866] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] debug = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.132996] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] default_availability_zones = [] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.133208] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.133342] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] dhcp_agent_notification = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.133471] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] dhcp_agents_per_network = 1 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.133597] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] dhcp_lease_duration = 86400 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.133731] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] dhcp_load_type = networks {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.133860] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] dns_domain = openstacklocal {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.134019] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.134160] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] enable_default_route_bfd = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.134290] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] enable_default_route_ecmp = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.134417] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] enable_dvr = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.134541] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] enable_new_agents = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.134665] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.134789] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] enable_signals = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.134913] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] enable_traditional_dhcp = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.135050] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] external_dns_driver = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.135180] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] filter_validation = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.135313] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] global_physnet_mtu = 8950 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.135439] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] graceful_shutdown_timeout = 60 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.135613] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] host = cpu-1 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.135747] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] host_dvr_for_dhcp = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.135877] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] http_retries = 3 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.136050] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] instance_format = [instance: %(uuid)s] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.136196] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.136330] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ipam_driver = internal {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.136469] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ipv6_pd_enabled = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.136617] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] l3_ha = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.136754] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.136886] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] l3_ha_network_physical_name = {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.137028] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] l3_ha_network_type = {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.137169] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] log_color = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.137302] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] log_config_append = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.137435] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.137562] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] log_dir = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.137686] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] log_file = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.137786] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] log_options = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.137914] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] log_rotate_interval = 1 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.138221] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] log_rotate_interval_type = days {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.138221] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] log_rotation_type = none {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.138322] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.138399] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.138508] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.138638] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.138737] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.138864] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] max_dns_nameservers = 5 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.138993] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] max_header_line = 16384 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.139135] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] max_l3_agents_per_router = 3 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.139261] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] max_logfile_count = 30 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.139386] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] max_logfile_size_mb = 200 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.139512] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] max_subnet_host_routes = 20 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.139645] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] my_ip = 10.180.1.21 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.139773] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] my_ipv6 = ::1 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.139899] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] network_auto_schedule = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.140029] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] network_link_prefix = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.140190] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.140341] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] notify_nova_on_port_data_changes = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.140477] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] notify_nova_on_port_status_changes = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.140609] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] pagination_max_limit = -1 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.140736] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] publish_errors = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.140864] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] rate_limit_burst = 0 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.140998] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] rate_limit_except_level = CRITICAL {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.141141] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] rate_limit_interval = 0 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.141269] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] retry_until_window = 30 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.141393] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] router_distributed = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.141519] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] rpc_resources_processing_step = 20 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.141645] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] rpc_response_max_timeout = 600 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.141771] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] rpc_response_timeout = 60 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.141900] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] send_events_interval = 2 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.142055] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] service_plugins = ['router'] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.142196] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] setproctitle = on {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.142323] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] shell_completion = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.142455] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] state_path = /opt/stack/data/neutron {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.142588] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] syslog_log_facility = LOG_USER {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.142716] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] tcp_keepidle = 600 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.142846] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] transport_url = **** {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.142974] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] use_journal = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.143112] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] use_json = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.143239] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] use_ssl = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.143364] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] use_stderr = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.143495] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] use_syslog = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.143619] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] vlan_qinq = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.143741] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] vlan_transparent = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.143866] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] watch_log_file = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.144021] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] wsgi_default_pool_size = 100 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.144166] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] wsgi_keep_alive = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.144301] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.144430] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] wsgi_server_debug = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.144577] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_concurrency.disable_process_locking = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.144912] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.144912] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.145021] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.145132] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.145263] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.145394] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.145537] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] profiler.connection_string = messaging:// {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.145671] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] profiler.enabled = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.145804] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] profiler.es_doc_type = notification {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.145982] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] profiler.es_scroll_size = 10000 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.146108] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] profiler.es_scroll_time = 2m {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.146239] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] profiler.filter_error_trace = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.146369] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] profiler.hmac_keys = **** {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.146503] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] profiler.sentinel_service_name = mymaster {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.146638] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] profiler.socket_timeout = 0.1 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.146767] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] profiler.trace_requests = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.146888] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] profiler.trace_sqlalchemy = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.147037] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] profiler_jaeger.process_tags = {} {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.147168] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] profiler_jaeger.service_name_prefix = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.147300] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] profiler_otlp.service_name_prefix = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.147440] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_policy.enforce_new_defaults = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.147703] env[66834]: WARNING oslo_config.cfg [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 525.147846] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_policy.enforce_scope = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.147985] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_policy.policy_default_rule = default {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.148143] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.148301] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.148450] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.148585] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.148713] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.148837] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.148966] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.149121] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_policy.remote_timeout = 60.0 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.149267] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.149407] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] agent.extensions = [] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.149541] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.149672] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] service_providers.service_provider = [] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.149808] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] QUOTAS.default_quota = -1 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.149944] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.150079] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] QUOTAS.quota_floatingip = 50 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.150209] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] QUOTAS.quota_network = 100 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.150335] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] QUOTAS.quota_port = 500 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.150462] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.150587] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] QUOTAS.quota_router = 10 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.150713] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] QUOTAS.quota_security_group = 10 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.150836] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.150961] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] QUOTAS.quota_subnet = 100 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.151100] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] QUOTAS.track_quota_usage = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.151244] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.151372] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep.group = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.151496] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep.helper_command = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.151622] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep.log_daemon_traceback = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.151755] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.151912] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep.thread_pool_size = 8 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.152030] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep.user = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.152155] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.152313] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_dhcp_release.group = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.152449] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_dhcp_release.helper_command = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.152580] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.152713] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.152840] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.152968] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_dhcp_release.user = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.153121] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.153247] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_ovs_vsctl.group = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.153374] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_ovs_vsctl.helper_command = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.153502] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.153635] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.153762] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.153889] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_ovs_vsctl.user = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.154032] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_namespace.capabilities = [21] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.154167] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_namespace.group = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.154291] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_namespace.helper_command = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.154416] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_namespace.log_daemon_traceback = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.154547] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.154676] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_namespace.thread_pool_size = 8 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.154800] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_namespace.user = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.154937] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_conntrack.capabilities = [12] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.155077] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_conntrack.group = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.155205] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_conntrack.helper_command = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.155330] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.155458] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.155588] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.155713] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_conntrack.user = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.155849] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_link.capabilities = [12, 21] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.156035] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_link.group = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.156155] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_link.helper_command = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.156287] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_link.log_daemon_traceback = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.156419] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.156547] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_link.thread_pool_size = 8 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.156673] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] privsep_link.user = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.156821] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.156967] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.157114] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] AGENT.continue_on_failed_promotions = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.157244] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] AGENT.dscp = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.157374] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] AGENT.dscp_inherit = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.157509] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] AGENT.force_mp_to_policy = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.157686] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] AGENT.locking_coordinator_url = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.157869] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] AGENT.log_agent_heartbeats = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.158024] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] AGENT.logging_expire = 1 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.158170] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.158332] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.158484] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] AGENT.polling_interval = 240 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.158619] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.158757] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.158900] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] AGENT.report_interval = 30.0 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.159061] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.159211] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.159348] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.159480] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] AGENT.sync_skew = 60 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.159608] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] AGENT.synchronization_queue_size = 20 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.159738] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] AGENT.use_helper_for_ns_read = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.159873] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] SECURITYGROUP.enable_ipset = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.160022] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] SECURITYGROUP.enable_security_group = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.160162] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.160367] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.160532] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] experimental.ipv6_pd_enabled = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.160688] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ml2.extension_drivers = ['port_security'] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.160817] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ml2.external_network_type = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.160960] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.161116] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ml2.overlay_ip_version = 4 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.161269] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ml2.path_mtu = 8950 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.161405] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ml2.physical_network_mtus = {} {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.161546] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ml2.tenant_network_types = ['vlan'] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.161681] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.161821] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ml2.type_drivers = ['vlan'] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.161960] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] AGENT_CLI.neutron_port_id = [] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.162104] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.162233] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.162373] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.162511] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.162645] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.162782] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.162916] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.163059] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.163263] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.163402] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] NSXV3.nsxv3_login_password = **** {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.163540] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] NSXV3.nsxv3_login_port = 443 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.163672] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] NSXV3.nsxv3_login_user = admin {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.163807] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.163959] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.164131] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.164275] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.164406] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.164547] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.164685] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.164818] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.164947] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.165097] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.165234] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.165366] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.165499] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.165693] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.165832] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] vsphere.vsphere_login_password = VMware1! {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.165993] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.166146] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.166284] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] nova.auth_section = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.166423] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] nova.auth_type = password {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.166557] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.166683] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] nova.certfile = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.166812] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] nova.collect_timing = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.166950] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] nova.endpoint_type = public {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.167092] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] nova.insecure = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.167217] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] nova.keyfile = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.167353] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] nova.region_name = RegionOne {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.167480] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] nova.split_loggers = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.167606] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] nova.timeout = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.167738] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] placement.auth_section = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.167873] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] placement.auth_type = password {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.168040] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.168176] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] placement.certfile = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.168328] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] placement.collect_timing = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.168477] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] placement.endpoint_type = public {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.168610] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] placement.insecure = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.168755] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] placement.keyfile = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.168977] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] placement.region_name = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.169204] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] placement.split_loggers = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.169408] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] placement.timeout = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.169594] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ironic.auth_section = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.169726] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ironic.auth_type = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.169852] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ironic.cafile = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.169977] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ironic.certfile = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.170121] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ironic.collect_timing = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.170248] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ironic.connect_retries = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.170400] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ironic.connect_retry_delay = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.170538] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ironic.enable_notifications = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.170666] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ironic.endpoint_override = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.170793] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ironic.insecure = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.170918] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ironic.interface = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.171057] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ironic.keyfile = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.171187] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ironic.max_version = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.171312] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ironic.min_version = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.171460] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ironic.region_name = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.171557] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ironic.retriable_status_codes = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.171676] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ironic.service_name = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.171801] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ironic.service_type = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.171925] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ironic.split_loggers = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.172061] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ironic.status_code_retries = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.172187] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ironic.status_code_retry_delay = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.172310] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ironic.timeout = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.172433] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ironic.valid_interfaces = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.172555] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ironic.version = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.172685] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] cli_script.dry_run = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.172824] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.172954] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.173094] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.173221] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.173349] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.173474] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.173598] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.173958] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.173958] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.174033] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.174145] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.174274] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.174408] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.174541] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.174671] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.174802] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.174929] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.175070] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.175204] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.175329] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.175466] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.175572] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.175783] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.175826] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.175982] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.176100] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.176303] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.176366] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.176470] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.176587] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.176712] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.ssl = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.176844] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.176977] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.177120] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.177253] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.177385] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.ssl_version = {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.177512] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.177648] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_notifications.driver = [] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.177779] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_notifications.retry = -1 {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.177923] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.178062] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] oslo_messaging_notifications.transport_url = **** {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.178169] env[66834]: DEBUG oslo_service.backend._eventlet.service [None req-63fdf7c5-91d9-48d3-950a-3e6bb3736a71 None None] ******************************************************************************** {{(pid=66834) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 525.179318] env[66834]: DEBUG neutron.agent.securitygroups_rpc [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Init firewall settings (driver=nsxv3) {{(pid=66834) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 525.180608] env[66834]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=66834) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 525.180844] env[66834]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] RPC agent_id: nsxm-l-01a.corp.local [ 525.183073] env[66834]: DEBUG dogpile.cache.region [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 525.183188] env[66834]: DEBUG dogpile.lock [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 525.183282] env[66834]: DEBUG dogpile.lock [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 525.183369] env[66834]: DEBUG dogpile.lock [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 525.183461] env[66834]: DEBUG dogpile.cache.region [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 525.183544] env[66834]: DEBUG dogpile.lock [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 525.183663] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 525.222921] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Session token - acquiring [ 525.224471] env[66834]: DEBUG networking_nsxv3.common.locking [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.224634] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.224753] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.225164] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.240679] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.515206] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 525.537907] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 525.538126] env[66834]: DEBUG dogpile.cache.region [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Cache value generated in 0.354 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 525.538174] env[66834]: DEBUG dogpile.lock [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 525.538305] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Activating Policy API Provider. [ 525.538493] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Looking for the default Infrastructure Rules. [ 525.605110] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Looking for the Default Layer3 Logged Drop Section. [ 525.620146] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 525.620599] env[66834]: DEBUG networking_nsxv3.common.locking [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.620763] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquiring lock "all" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.620863] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquired lock "all" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.621169] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquired external semaphore "all" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.621492] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 526.136094] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 526.638615] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 527.140923] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Inventory metadata is going to be refreshed. [ 527.141348] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 527.949871] env[66834]: DEBUG networking_nsxv3.common.locking [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.950226] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.950226] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.950462] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.966590] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 527.968064] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.968952] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 527.991511] env[66834]: DEBUG networking_nsxv3.common.locking [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.991726] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.991786] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.992096] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.992264] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.992457] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 527.992574] env[66834]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=66834) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.992712] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 528.014920] env[66834]: DEBUG networking_nsxv3.common.locking [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.015171] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.015244] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.015480] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.015798] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.015798] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 528.040349] env[66834]: DEBUG networking_nsxv3.common.locking [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.040597] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.040597] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.040889] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.041045] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.041192] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 528.061999] env[66834]: DEBUG networking_nsxv3.common.locking [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.062259] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquiring lock "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.062303] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquired lock "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.062565] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquired external semaphore "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.062702] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Releasing lock "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.062858] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 528.062965] env[66834]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=66834) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 528.063079] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 528.082455] env[66834]: DEBUG networking_nsxv3.common.locking [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.082699] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquiring lock "Segment QoS" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.082745] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquired lock "Segment QoS" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.083015] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquired external semaphore "Segment QoS" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.083148] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Releasing lock "Segment QoS" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.083291] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 528.083395] env[66834]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=66834) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 528.083497] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 528.104347] env[66834]: DEBUG networking_nsxv3.common.locking [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.104584] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.104626] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.104940] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.105099] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.105394] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 528.105876] env[66834]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66834) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 528.106148] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Inventory metadata have been refreshed. [ 528.106317] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Dryrun:True. Metadata refresh completed. [ 528.106430] env[66834]: DEBUG oslo_concurrency.lockutils [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Releasing lock "all" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.108182] env[66834]: INFO neutron.agent.agent_extensions_manager [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Loaded agent extensions: [] [ 528.108928] env[66834]: DEBUG neutron_lib.callbacks.manager [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=66834) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 528.161437] env[66834]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] NSXv3 Agent Agent RPC Daemon Started! [ 528.161828] env[66834]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] NSXv3 Agent Agent loop - iteration:0 started [ 528.161828] env[66834]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] NSXv3 Agent Agent out of sync with plugin! [ 533.109735] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 533.110022] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 536.112015] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.112513] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.112513] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 536.112658] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 536.112737] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 536.615544] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 537.118272] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 537.621593] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 537.621593] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 538.110520] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 538.110728] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 538.407136] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.407559] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.407559] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.407644] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.419705] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 538.420548] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.421137] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 538.437705] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.437892] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.437892] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.438126] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.438216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.438313] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 538.438384] env[66834]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66834) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 538.438453] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 538.457062] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.457285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.457285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.457467] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.457591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.457717] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 538.479360] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.479612] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.479612] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.479741] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.479838] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.479943] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 538.508597] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.508902] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.508902] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.509037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.509125] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.509447] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 538.509598] env[66834]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=66834) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 538.509598] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 538.527956] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.528243] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.528243] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.528351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.528428] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.528535] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 538.528604] env[66834]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66834) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 538.528674] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 538.548113] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.548303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.548345] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.548539] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.548651] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.548764] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 538.548833] env[66834]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66834) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 538.548899] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 538.548961] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 538.549049] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 538.549110] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 538.549163] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 538.549424] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 538.549488] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 538.549556] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 538.568467] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.568674] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.568674] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.568839] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.568937] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.569055] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 538.587484] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.587681] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.587719] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.587899] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.588011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.600474] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.112387] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 543.112662] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 543.197933] env[66834]: INFO networking_nsxv3.common.synchronization [None req-21f0c8bb-9882-48cb-acc1-384cdfba989b demo admin] Enqueued Resource ID: 7561d1f6-0624-4ba1-a27f-6d479f2080aa with Priority: HIGHEST for action security_group_rules [ 543.198485] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7561d1f6-0624-4ba1-a27f-6d479f2080aa with Priority: HIGHEST for action security_group_rules [ 543.198781] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7561d1f6-0624-4ba1-a27f-6d479f2080aa taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.199361] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7561d1f6-0624-4ba1-a27f-6d479f2080aa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.199441] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7561d1f6-0624-4ba1-a27f-6d479f2080aa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.199691] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7561d1f6-0624-4ba1-a27f-6d479f2080aa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.199777] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7561d1f6-0624-4ba1-a27f-6d479f2080aa',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.723353] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.723621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.723621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.723788] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.723843] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.723932] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7561d1f6-0624-4ba1-a27f-6d479f2080aa already deleted. [ 543.724030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7561d1f6-0624-4ba1-a27f-6d479f2080aa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 548.199638] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 548.200082] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 553.200329] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 553.200711] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 558.201487] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 558.201907] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 563.202131] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 563.204171] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 568.203366] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 568.203718] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 571.327093] env[66834]: INFO networking_nsxv3.common.synchronization [None req-8dcd9de2-51f6-4259-b787-76ff506d2480 None None] Enqueued Resource ID: 4e0ea3fc-eb02-4285-92be-6767c26f108b with Priority: HIGHEST for action port [ 571.328299] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e0ea3fc-eb02-4285-92be-6767c26f108b with Priority: HIGHEST for action port [ 571.328299] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e0ea3fc-eb02-4285-92be-6767c26f108b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.328299] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e0ea3fc-eb02-4285-92be-6767c26f108b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.328299] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e0ea3fc-eb02-4285-92be-6767c26f108b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.328547] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e0ea3fc-eb02-4285-92be-6767c26f108b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.328547] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e0ea3fc-eb02-4285-92be-6767c26f108b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.830901] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4e0ea3fc-eb02-4285-92be-6767c26f108b [ 571.831171] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.831311] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.831380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.831590] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.831679] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.831772] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4e0ea3fc-eb02-4285-92be-6767c26f108b already deleted. [ 571.831853] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e0ea3fc-eb02-4285-92be-6767c26f108b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.286835] env[66834]: INFO networking_nsxv3.common.synchronization [None req-f062beae-7ec8-4143-93e8-230c8e57c1f3 None None] Enqueued Resource ID: cbf7b291-8f31-410a-a3d9-0f3faf6e6c5c with Priority: HIGHEST for action port [ 573.287578] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbf7b291-8f31-410a-a3d9-0f3faf6e6c5c with Priority: HIGHEST for action port [ 573.287706] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbf7b291-8f31-410a-a3d9-0f3faf6e6c5c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.287853] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbf7b291-8f31-410a-a3d9-0f3faf6e6c5c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.287920] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbf7b291-8f31-410a-a3d9-0f3faf6e6c5c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.288455] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbf7b291-8f31-410a-a3d9-0f3faf6e6c5c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.288455] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbf7b291-8f31-410a-a3d9-0f3faf6e6c5c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.792443] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cbf7b291-8f31-410a-a3d9-0f3faf6e6c5c [ 573.792595] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.792659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.792916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.792916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.793329] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.793329] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cbf7b291-8f31-410a-a3d9-0f3faf6e6c5c already deleted. [ 573.793329] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbf7b291-8f31-410a-a3d9-0f3faf6e6c5c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.747678] env[66834]: INFO networking_nsxv3.common.synchronization [None req-e6be901b-1e85-42ff-b16e-93efb994765c None None] Enqueued Resource ID: a8354ff9-1fe8-4c8f-bca7-5e2e8ad912d8 with Priority: HIGHEST for action port [ 574.749052] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8354ff9-1fe8-4c8f-bca7-5e2e8ad912d8 with Priority: HIGHEST for action port [ 574.751066] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8354ff9-1fe8-4c8f-bca7-5e2e8ad912d8 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.751066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8354ff9-1fe8-4c8f-bca7-5e2e8ad912d8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.751066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8354ff9-1fe8-4c8f-bca7-5e2e8ad912d8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.751066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8354ff9-1fe8-4c8f-bca7-5e2e8ad912d8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.751066] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8354ff9-1fe8-4c8f-bca7-5e2e8ad912d8',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.785787] env[66834]: INFO networking_nsxv3.common.synchronization [None req-f136212d-e073-4d1a-8609-09f887a9b4c5 None None] Enqueued Resource ID: 4b2f4c7b-3902-4ab3-b8be-806d31966736 with Priority: HIGHEST for action port [ 574.786304] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b2f4c7b-3902-4ab3-b8be-806d31966736 with Priority: HIGHEST for action port [ 574.786630] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b2f4c7b-3902-4ab3-b8be-806d31966736 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.786872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b2f4c7b-3902-4ab3-b8be-806d31966736" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.786872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b2f4c7b-3902-4ab3-b8be-806d31966736" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.788067] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b2f4c7b-3902-4ab3-b8be-806d31966736" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.788188] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b2f4c7b-3902-4ab3-b8be-806d31966736',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.252957] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8354ff9-1fe8-4c8f-bca7-5e2e8ad912d8 [ 575.252957] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.253872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.253872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.253872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.253872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.253872] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8354ff9-1fe8-4c8f-bca7-5e2e8ad912d8 already deleted. [ 575.253872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8354ff9-1fe8-4c8f-bca7-5e2e8ad912d8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.292358] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b2f4c7b-3902-4ab3-b8be-806d31966736 [ 575.292693] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.292845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.292919] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.293149] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.293253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.293661] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b2f4c7b-3902-4ab3-b8be-806d31966736 already deleted. [ 575.293661] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b2f4c7b-3902-4ab3-b8be-806d31966736" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.693506] env[66834]: INFO networking_nsxv3.common.synchronization [None req-1b30fbe7-3bb0-40fc-a232-2b6fcb3ad884 None None] Enqueued Resource ID: ddb392e7-6bcb-499e-9760-36ddccacb2f4 with Priority: HIGHEST for action port [ 575.694074] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddb392e7-6bcb-499e-9760-36ddccacb2f4 with Priority: HIGHEST for action port [ 575.694380] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddb392e7-6bcb-499e-9760-36ddccacb2f4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.694503] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddb392e7-6bcb-499e-9760-36ddccacb2f4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.694569] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddb392e7-6bcb-499e-9760-36ddccacb2f4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.694821] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddb392e7-6bcb-499e-9760-36ddccacb2f4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.694899] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddb392e7-6bcb-499e-9760-36ddccacb2f4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.197407] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ddb392e7-6bcb-499e-9760-36ddccacb2f4 [ 576.197689] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.197935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.197935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.198890] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.198890] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.198890] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ddb392e7-6bcb-499e-9760-36ddccacb2f4 already deleted. [ 576.198890] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddb392e7-6bcb-499e-9760-36ddccacb2f4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.141539] env[66834]: INFO networking_nsxv3.common.synchronization [None req-ef2dea98-0440-45d6-9e64-d7bac8c21892 None None] Enqueued Resource ID: 1b2bc3ab-eafc-4cca-b00a-f3d386fa8918 with Priority: HIGHEST for action port [ 577.142967] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b2bc3ab-eafc-4cca-b00a-f3d386fa8918 with Priority: HIGHEST for action port [ 577.143304] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b2bc3ab-eafc-4cca-b00a-f3d386fa8918 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.143304] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b2bc3ab-eafc-4cca-b00a-f3d386fa8918" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.143531] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b2bc3ab-eafc-4cca-b00a-f3d386fa8918" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.143571] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b2bc3ab-eafc-4cca-b00a-f3d386fa8918" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.143638] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b2bc3ab-eafc-4cca-b00a-f3d386fa8918',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.175161] env[66834]: INFO networking_nsxv3.common.synchronization [None req-9d495269-d070-4e8f-b3a2-f5641047bfd8 None None] Enqueued Resource ID: 108677b0-d47d-4683-8b67-fbb2cf5d8dbc with Priority: HIGHEST for action port [ 577.175161] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108677b0-d47d-4683-8b67-fbb2cf5d8dbc with Priority: HIGHEST for action port [ 577.175546] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-108677b0-d47d-4683-8b67-fbb2cf5d8dbc taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.175659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-108677b0-d47d-4683-8b67-fbb2cf5d8dbc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.175659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-108677b0-d47d-4683-8b67-fbb2cf5d8dbc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.179018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-108677b0-d47d-4683-8b67-fbb2cf5d8dbc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.179018] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('108677b0-d47d-4683-8b67-fbb2cf5d8dbc',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.646920] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b2bc3ab-eafc-4cca-b00a-f3d386fa8918 [ 577.647272] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.647861] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.647958] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.648191] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.648259] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.648351] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b2bc3ab-eafc-4cca-b00a-f3d386fa8918 already deleted. [ 577.648431] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b2bc3ab-eafc-4cca-b00a-f3d386fa8918" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.681985] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 108677b0-d47d-4683-8b67-fbb2cf5d8dbc [ 577.682182] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.682491] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.682491] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.682664] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.682715] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.682831] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:108677b0-d47d-4683-8b67-fbb2cf5d8dbc already deleted. [ 577.682883] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-108677b0-d47d-4683-8b67-fbb2cf5d8dbc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.865215] env[66834]: INFO networking_nsxv3.common.synchronization [None req-990dc91b-6d48-4b63-977c-6c55e5a39919 None None] Enqueued Resource ID: 986d60c5-9199-4cbe-aa0f-1f650a608ee0 with Priority: HIGHEST for action port [ 578.865503] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 986d60c5-9199-4cbe-aa0f-1f650a608ee0 with Priority: HIGHEST for action port [ 578.866178] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-986d60c5-9199-4cbe-aa0f-1f650a608ee0 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.866178] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-986d60c5-9199-4cbe-aa0f-1f650a608ee0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.866350] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-986d60c5-9199-4cbe-aa0f-1f650a608ee0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.866497] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-986d60c5-9199-4cbe-aa0f-1f650a608ee0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.866549] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('986d60c5-9199-4cbe-aa0f-1f650a608ee0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.161132] env[66834]: INFO networking_nsxv3.common.synchronization [None req-e2607c2f-ffa1-47bc-b176-ba0f8a37b1b5 None None] Enqueued Resource ID: 67e5b1a1-70aa-4566-91f3-cb14f30e9a45 with Priority: HIGHEST for action port [ 579.162099] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67e5b1a1-70aa-4566-91f3-cb14f30e9a45 with Priority: HIGHEST for action port [ 579.163393] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-67e5b1a1-70aa-4566-91f3-cb14f30e9a45 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.164032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67e5b1a1-70aa-4566-91f3-cb14f30e9a45" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.164181] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67e5b1a1-70aa-4566-91f3-cb14f30e9a45" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.164958] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67e5b1a1-70aa-4566-91f3-cb14f30e9a45" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.164958] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67e5b1a1-70aa-4566-91f3-cb14f30e9a45',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.368659] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 986d60c5-9199-4cbe-aa0f-1f650a608ee0 [ 579.369792] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.369792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.369792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.369792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.369792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.369792] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:986d60c5-9199-4cbe-aa0f-1f650a608ee0 already deleted. [ 579.369792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-986d60c5-9199-4cbe-aa0f-1f650a608ee0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.623163] env[66834]: INFO networking_nsxv3.common.synchronization [None req-35aef55e-1f8d-4972-9ec5-f3b53ae95f90 None None] Enqueued Resource ID: 25a9b3bb-e958-45b6-99a0-b9ec9e6429f4 with Priority: HIGHEST for action port [ 579.623163] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25a9b3bb-e958-45b6-99a0-b9ec9e6429f4 with Priority: HIGHEST for action port [ 579.623163] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-25a9b3bb-e958-45b6-99a0-b9ec9e6429f4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.623163] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25a9b3bb-e958-45b6-99a0-b9ec9e6429f4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.623163] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25a9b3bb-e958-45b6-99a0-b9ec9e6429f4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.623163] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25a9b3bb-e958-45b6-99a0-b9ec9e6429f4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.623163] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25a9b3bb-e958-45b6-99a0-b9ec9e6429f4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.666976] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67e5b1a1-70aa-4566-91f3-cb14f30e9a45 [ 579.667326] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.667518] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.667684] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.667786] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.667944] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.668989] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67e5b1a1-70aa-4566-91f3-cb14f30e9a45 already deleted. [ 579.668989] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67e5b1a1-70aa-4566-91f3-cb14f30e9a45" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.125923] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 25a9b3bb-e958-45b6-99a0-b9ec9e6429f4 [ 580.126288] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.127204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.127204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.127204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.127204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.127204] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:25a9b3bb-e958-45b6-99a0-b9ec9e6429f4 already deleted. [ 580.127204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25a9b3bb-e958-45b6-99a0-b9ec9e6429f4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.943440] env[66834]: INFO networking_nsxv3.common.synchronization [None req-2cfb79ef-f621-493d-99ce-a92820e6a7a5 None None] Enqueued Resource ID: 94c3f9d5-7eae-4b5a-8d31-31f826039c10 with Priority: HIGHEST for action port [ 580.943440] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94c3f9d5-7eae-4b5a-8d31-31f826039c10 with Priority: HIGHEST for action port [ 580.944038] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-94c3f9d5-7eae-4b5a-8d31-31f826039c10 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.944168] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94c3f9d5-7eae-4b5a-8d31-31f826039c10" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.944235] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94c3f9d5-7eae-4b5a-8d31-31f826039c10" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.944585] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94c3f9d5-7eae-4b5a-8d31-31f826039c10" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.944585] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94c3f9d5-7eae-4b5a-8d31-31f826039c10',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.451672] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94c3f9d5-7eae-4b5a-8d31-31f826039c10 [ 581.451672] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.451672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.451672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.451672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.451672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.451672] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94c3f9d5-7eae-4b5a-8d31-31f826039c10 already deleted. [ 581.451672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94c3f9d5-7eae-4b5a-8d31-31f826039c10" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.705834] env[66834]: INFO networking_nsxv3.common.synchronization [None req-c2ca07cb-2cc2-4963-a399-0ec7bfcc2490 None None] Enqueued Resource ID: c179d11a-69d7-4647-ab83-d48cb13cf564 with Priority: HIGHEST for action port [ 581.706114] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c179d11a-69d7-4647-ab83-d48cb13cf564 with Priority: HIGHEST for action port [ 581.706667] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-c179d11a-69d7-4647-ab83-d48cb13cf564 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.706905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c179d11a-69d7-4647-ab83-d48cb13cf564" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.707041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c179d11a-69d7-4647-ab83-d48cb13cf564" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.708434] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c179d11a-69d7-4647-ab83-d48cb13cf564" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.709598] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c179d11a-69d7-4647-ab83-d48cb13cf564',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.211022] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c179d11a-69d7-4647-ab83-d48cb13cf564 [ 582.211209] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.211353] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.211423] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.211632] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.211724] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.211818] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c179d11a-69d7-4647-ab83-d48cb13cf564 already deleted. [ 582.211899] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c179d11a-69d7-4647-ab83-d48cb13cf564" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.074269] env[66834]: INFO networking_nsxv3.common.synchronization [None req-79e9733c-3b1b-43be-ad4c-58096957a983 None None] Enqueued Resource ID: 7a7f6546-9268-4844-9e20-b88ed251c0fb with Priority: HIGHEST for action port [ 583.074585] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a7f6546-9268-4844-9e20-b88ed251c0fb with Priority: HIGHEST for action port [ 583.077668] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a7f6546-9268-4844-9e20-b88ed251c0fb taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.077668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a7f6546-9268-4844-9e20-b88ed251c0fb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.077668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a7f6546-9268-4844-9e20-b88ed251c0fb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.077668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a7f6546-9268-4844-9e20-b88ed251c0fb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.077668] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a7f6546-9268-4844-9e20-b88ed251c0fb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.484287] env[66834]: INFO networking_nsxv3.common.synchronization [None req-116deb0b-38f7-451d-8e58-2d5b10cc1ca1 None None] Enqueued Resource ID: 060c4781-5488-4d48-bf30-9a2a6ede9467 with Priority: HIGHEST for action port [ 583.487720] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 060c4781-5488-4d48-bf30-9a2a6ede9467 with Priority: HIGHEST for action port [ 583.488687] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-060c4781-5488-4d48-bf30-9a2a6ede9467 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.488687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-060c4781-5488-4d48-bf30-9a2a6ede9467" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.489604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-060c4781-5488-4d48-bf30-9a2a6ede9467" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.489604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-060c4781-5488-4d48-bf30-9a2a6ede9467" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.489604] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('060c4781-5488-4d48-bf30-9a2a6ede9467',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.580413] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a7f6546-9268-4844-9e20-b88ed251c0fb [ 583.580413] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.580413] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.580413] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.580413] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.580413] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.580413] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a7f6546-9268-4844-9e20-b88ed251c0fb already deleted. [ 583.580413] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a7f6546-9268-4844-9e20-b88ed251c0fb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.993793] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 060c4781-5488-4d48-bf30-9a2a6ede9467 [ 583.994269] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.994488] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.994708] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.995124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.995273] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.995423] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:060c4781-5488-4d48-bf30-9a2a6ede9467 already deleted. [ 583.995559] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-060c4781-5488-4d48-bf30-9a2a6ede9467" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.349647] env[66834]: INFO networking_nsxv3.common.synchronization [None req-c4cf519e-6760-4349-814b-50e1ba2ee88b None None] Enqueued Resource ID: 8cab7994-cdfd-4474-a227-9a325a2621f0 with Priority: HIGHEST for action port [ 584.350187] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cab7994-cdfd-4474-a227-9a325a2621f0 with Priority: HIGHEST for action port [ 584.350498] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cab7994-cdfd-4474-a227-9a325a2621f0 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.350616] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cab7994-cdfd-4474-a227-9a325a2621f0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.350681] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cab7994-cdfd-4474-a227-9a325a2621f0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.350922] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cab7994-cdfd-4474-a227-9a325a2621f0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.350997] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cab7994-cdfd-4474-a227-9a325a2621f0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.854075] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8cab7994-cdfd-4474-a227-9a325a2621f0 [ 584.854075] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.854977] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.854977] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.855233] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.856308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.856308] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8cab7994-cdfd-4474-a227-9a325a2621f0 already deleted. [ 584.856308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cab7994-cdfd-4474-a227-9a325a2621f0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.023587] env[66834]: INFO networking_nsxv3.common.synchronization [None req-7aa2ad4a-a3c4-4dde-8c58-3de00b6790c0 None None] Enqueued Resource ID: 9ec2eb4b-c3aa-4e0d-a4db-721a421df425 with Priority: HIGHEST for action port [ 585.024090] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ec2eb4b-c3aa-4e0d-a4db-721a421df425 with Priority: HIGHEST for action port [ 585.024398] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ec2eb4b-c3aa-4e0d-a4db-721a421df425 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.024519] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ec2eb4b-c3aa-4e0d-a4db-721a421df425" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.024583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ec2eb4b-c3aa-4e0d-a4db-721a421df425" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.024843] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ec2eb4b-c3aa-4e0d-a4db-721a421df425" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.025301] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ec2eb4b-c3aa-4e0d-a4db-721a421df425',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.522275] env[66834]: INFO networking_nsxv3.common.synchronization [None req-7b9e1c01-78ea-4493-b72c-75f816c76c2a None None] Enqueued Resource ID: d25a6eae-6e2e-4c8b-be9a-8b575c556565 with Priority: HIGHEST for action port [ 585.522790] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d25a6eae-6e2e-4c8b-be9a-8b575c556565 with Priority: HIGHEST for action port [ 585.523110] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-d25a6eae-6e2e-4c8b-be9a-8b575c556565 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.523237] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d25a6eae-6e2e-4c8b-be9a-8b575c556565" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.523304] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d25a6eae-6e2e-4c8b-be9a-8b575c556565" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.523551] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d25a6eae-6e2e-4c8b-be9a-8b575c556565" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.523631] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d25a6eae-6e2e-4c8b-be9a-8b575c556565',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.527375] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ec2eb4b-c3aa-4e0d-a4db-721a421df425 [ 585.527566] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.527673] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.527763] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.527951] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.528140] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.528232] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ec2eb4b-c3aa-4e0d-a4db-721a421df425 already deleted. [ 585.528319] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ec2eb4b-c3aa-4e0d-a4db-721a421df425" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.028037] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d25a6eae-6e2e-4c8b-be9a-8b575c556565 [ 586.028037] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.028037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.028037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.029746] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.029746] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.029746] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d25a6eae-6e2e-4c8b-be9a-8b575c556565 already deleted. [ 586.029746] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d25a6eae-6e2e-4c8b-be9a-8b575c556565" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.268170] env[66834]: INFO networking_nsxv3.common.synchronization [None req-64a3c44d-11d1-4719-97b6-20f2dc0f6258 None None] Enqueued Resource ID: b1165b84-a9b1-4a85-abd9-3599a4e0942d with Priority: HIGHEST for action port [ 587.268730] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1165b84-a9b1-4a85-abd9-3599a4e0942d with Priority: HIGHEST for action port [ 587.269156] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1165b84-a9b1-4a85-abd9-3599a4e0942d taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.269156] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1165b84-a9b1-4a85-abd9-3599a4e0942d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.269505] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1165b84-a9b1-4a85-abd9-3599a4e0942d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.269505] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1165b84-a9b1-4a85-abd9-3599a4e0942d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.269638] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1165b84-a9b1-4a85-abd9-3599a4e0942d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.589395] env[66834]: INFO networking_nsxv3.common.synchronization [req-a9aee30b-30ed-4329-9a89-24f00cf9b00e req-e6966436-e3af-48f1-9bed-04c5fc9ce5a6 tempest-TenantUsagesTestJSON-996040502 tempest-TenantUsagesTestJSON-996040502-project-member] Enqueued Resource ID: d9115622-9b53-4106-895d-803c18358d29 with Priority: HIGHEST for action security_group_members [ 587.589999] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9115622-9b53-4106-895d-803c18358d29 with Priority: HIGHEST for action security_group_members [ 587.590285] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9115622-9b53-4106-895d-803c18358d29 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.590412] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.590484] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.590723] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.590875] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.591024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.591156] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.591204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.591262] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.591351] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9115622-9b53-4106-895d-803c18358d29',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.774077] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b1165b84-a9b1-4a85-abd9-3599a4e0942d [ 587.774507] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.774507] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.774507] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.775627] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.775725] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.776094] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b1165b84-a9b1-4a85-abd9-3599a4e0942d already deleted. [ 587.776094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1165b84-a9b1-4a85-abd9-3599a4e0942d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.094940] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.094940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.094940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.094940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.094940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.094940] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.094940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.094940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.094940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.094940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.094940] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9115622-9b53-4106-895d-803c18358d29 already deleted. [ 588.094940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.376134] env[66834]: INFO networking_nsxv3.common.synchronization [None req-67912a67-f5a6-4670-82b2-c354d81a170a None None] Enqueued Resource ID: eb4aa143-3715-4030-ac23-1c8eda7623a1 with Priority: HIGHEST for action port [ 588.376417] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb4aa143-3715-4030-ac23-1c8eda7623a1 with Priority: HIGHEST for action port [ 588.379110] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb4aa143-3715-4030-ac23-1c8eda7623a1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.379375] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb4aa143-3715-4030-ac23-1c8eda7623a1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.379443] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb4aa143-3715-4030-ac23-1c8eda7623a1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.379665] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb4aa143-3715-4030-ac23-1c8eda7623a1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.379751] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb4aa143-3715-4030-ac23-1c8eda7623a1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.536288] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-582 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.536288] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.536288] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.536732] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.536732] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.536834] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.536871] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.537918] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.537918] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.537918] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 588.537918] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 588.537918] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 588.537918] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 588.538280] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 588.538280] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 588.538577] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 588.561296] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 588.561398] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 588.561570] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 588.561752] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.562133] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-6b25ae9b-c535-4d7e-b6aa-26d8777ff709 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.562339] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-6b25ae9b-c535-4d7e-b6aa-26d8777ff709" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.562471] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-6b25ae9b-c535-4d7e-b6aa-26d8777ff709" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.562802] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-6b25ae9b-c535-4d7e-b6aa-26d8777ff709" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.562926] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b25ae9b-c535-4d7e-b6aa-26d8777ff709',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.883209] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb4aa143-3715-4030-ac23-1c8eda7623a1 [ 588.883209] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.883209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.883209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.883209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.883209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.883209] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb4aa143-3715-4030-ac23-1c8eda7623a1 already deleted. [ 588.883651] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb4aa143-3715-4030-ac23-1c8eda7623a1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.034367] env[66834]: INFO networking_nsxv3.common.synchronization [None req-de39f333-9631-4581-be90-c32e5fb3ca91 None None] Enqueued Resource ID: 988a5014-ff4d-4f6c-b2b6-65c2866aa8a0 with Priority: HIGHEST for action port [ 589.037192] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988a5014-ff4d-4f6c-b2b6-65c2866aa8a0 with Priority: HIGHEST for action port [ 589.037730] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-988a5014-ff4d-4f6c-b2b6-65c2866aa8a0 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.037856] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-988a5014-ff4d-4f6c-b2b6-65c2866aa8a0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.037918] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-988a5014-ff4d-4f6c-b2b6-65c2866aa8a0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.039701] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-988a5014-ff4d-4f6c-b2b6-65c2866aa8a0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.039828] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('988a5014-ff4d-4f6c-b2b6-65c2866aa8a0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.067689] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.068009] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.072517] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.072908] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.072908] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.072908] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 6b25ae9b-c535-4d7e-b6aa-26d8777ff709 not found, creating... [ 589.073480] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.073480] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.073480] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.074166] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.074166] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.074166] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.074384] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.074384] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.074612] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.074746] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.074878] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 6b25ae9b-c535-4d7e-b6aa-26d8777ff709 is going to be created. [ 589.084540] env[66834]: INFO networking_nsxv3.common.synchronization [req-6235cbde-22a6-4c1b-a01e-456dca546b57 req-c9a6fe41-e272-46ca-bb64-c23642587cf2 tempest-DeleteServersAdminTestJSON-46265615 tempest-DeleteServersAdminTestJSON-46265615-project-member] Enqueued Resource ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 with Priority: HIGHEST for action security_group_members [ 589.085679] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 with Priority: HIGHEST for action security_group_members [ 589.085679] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.085679] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.085679] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.085891] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.086375] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.089784] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.089874] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.090966] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.090966] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.090966] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b93eb01-51cc-4c25-b2fa-56b4a62620d3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.100599] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.100599] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.100780] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.100982] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.101251] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.101583] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-6b25ae9b-c535-4d7e-b6aa-26d8777ff709" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.297219] env[66834]: INFO networking_nsxv3.common.synchronization [None req-3226dc54-8d41-441f-b00c-8c035b9155fa None None] Enqueued Resource ID: dc020f8d-2c77-456b-b0b9-d36df2d9083f with Priority: HIGHEST for action port [ 589.297801] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc020f8d-2c77-456b-b0b9-d36df2d9083f with Priority: HIGHEST for action port [ 589.298293] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc020f8d-2c77-456b-b0b9-d36df2d9083f taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.298427] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc020f8d-2c77-456b-b0b9-d36df2d9083f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.298490] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc020f8d-2c77-456b-b0b9-d36df2d9083f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.298964] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc020f8d-2c77-456b-b0b9-d36df2d9083f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.298964] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc020f8d-2c77-456b-b0b9-d36df2d9083f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.541683] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 988a5014-ff4d-4f6c-b2b6-65c2866aa8a0 [ 589.541933] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.542246] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.542246] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.542426] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.542517] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.542609] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:988a5014-ff4d-4f6c-b2b6-65c2866aa8a0 already deleted. [ 589.542686] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-988a5014-ff4d-4f6c-b2b6-65c2866aa8a0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.598023] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.598023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.598023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.598023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.598023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.598023] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.598023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.598023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.598023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.598023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.598023] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 already deleted. [ 589.598023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.802408] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc020f8d-2c77-456b-b0b9-d36df2d9083f [ 589.802729] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.802968] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.803046] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.803285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.803449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.803620] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc020f8d-2c77-456b-b0b9-d36df2d9083f already deleted. [ 589.803758] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc020f8d-2c77-456b-b0b9-d36df2d9083f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.919265] env[66834]: INFO networking_nsxv3.common.synchronization [req-a9aee30b-30ed-4329-9a89-24f00cf9b00e req-3a9b2353-8ff7-4e49-a416-7131ae46ddf5 service nova] Enqueued Resource ID: d9115622-9b53-4106-895d-803c18358d29 with Priority: HIGHEST for action security_group_rules [ 589.919436] env[66834]: INFO networking_nsxv3.common.synchronization [req-a9aee30b-30ed-4329-9a89-24f00cf9b00e req-3a9b2353-8ff7-4e49-a416-7131ae46ddf5 service nova] Enqueued Resource ID: d9115622-9b53-4106-895d-803c18358d29 with Priority: HIGHEST for action security_group_members [ 589.919569] env[66834]: INFO networking_nsxv3.common.synchronization [req-a9aee30b-30ed-4329-9a89-24f00cf9b00e req-3a9b2353-8ff7-4e49-a416-7131ae46ddf5 service nova] Enqueued Resource ID: 6b25ae9b-c535-4d7e-b6aa-26d8777ff709 with Priority: HIGHEST for action port [ 589.919793] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9115622-9b53-4106-895d-803c18358d29 with Priority: HIGHEST for action security_group_rules [ 589.919924] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9115622-9b53-4106-895d-803c18358d29 with Priority: HIGHEST for action security_group_members [ 589.920031] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b25ae9b-c535-4d7e-b6aa-26d8777ff709 with Priority: HIGHEST for action port [ 589.921017] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9115622-9b53-4106-895d-803c18358d29 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.921294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.921294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.921458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.921533] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9115622-9b53-4106-895d-803c18358d29',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.922986] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9115622-9b53-4106-895d-803c18358d29 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.922986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.922986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.922986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.922986] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.922986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.922986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.923387] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.923387] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.923387] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9115622-9b53-4106-895d-803c18358d29',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.924916] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b25ae9b-c535-4d7e-b6aa-26d8777ff709 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.924916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b25ae9b-c535-4d7e-b6aa-26d8777ff709" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.924916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b25ae9b-c535-4d7e-b6aa-26d8777ff709" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.924916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b25ae9b-c535-4d7e-b6aa-26d8777ff709" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.924916] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b25ae9b-c535-4d7e-b6aa-26d8777ff709',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.986584] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-582 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.986789] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.986877] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.987195] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.987447] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.987600] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.987710] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.987917] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.988196] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.988265] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 589.988363] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 589.988467] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 589.988641] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 589.988765] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 589.988871] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 589.988995] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 590.007339] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 590.007490] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 590.007625] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 590.007808] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.008210] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-c005dc96-0384-4ce2-b550-164e1b0ab0cf taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.008374] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-c005dc96-0384-4ce2-b550-164e1b0ab0cf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.008484] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-c005dc96-0384-4ce2-b550-164e1b0ab0cf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.008800] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-c005dc96-0384-4ce2-b550-164e1b0ab0cf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.008930] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c005dc96-0384-4ce2-b550-164e1b0ab0cf',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.427531] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9115622-9b53-4106-895d-803c18358d29 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.427721] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.442637] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9115622-9b53-4106-895d-803c18358d29',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.443755] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b25ae9b-c535-4d7e-b6aa-26d8777ff709 with status ACTIVE [ 590.444076] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.444269] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.444378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.444686] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.444815] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.446380] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.446380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.446380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.446380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.446625] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.446660] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.446768] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.446831] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.447034] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.447113] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.447202] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b25ae9b-c535-4d7e-b6aa-26d8777ff709 is going to be updated. [ 590.470441] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.470441] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.470693] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.471266] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.471266] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.471266] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b25ae9b-c535-4d7e-b6aa-26d8777ff709" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.512378] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.512378] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.512378] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.512378] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.512777] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.515207] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port c005dc96-0384-4ce2-b550-164e1b0ab0cf not found, creating... [ 590.515207] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.515207] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.515207] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.515207] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.515207] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.515207] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.518085] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.518085] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.518085] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.518085] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.518085] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: c005dc96-0384-4ce2-b550-164e1b0ab0cf is going to be created. [ 590.539483] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.539483] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.539483] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.540785] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.547519] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.547519] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-c005dc96-0384-4ce2-b550-164e1b0ab0cf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.949439] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9115622-9b53-4106-895d-803c18358d29',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.991753] env[66834]: INFO networking_nsxv3.common.synchronization [None req-b2414196-ca0e-4226-91d9-81813740c670 None None] Enqueued Resource ID: c6c0681f-919d-4861-8362-78f6b9e0684e with Priority: HIGHEST for action port [ 590.992217] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6c0681f-919d-4861-8362-78f6b9e0684e with Priority: HIGHEST for action port [ 590.992508] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6c0681f-919d-4861-8362-78f6b9e0684e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.992628] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6c0681f-919d-4861-8362-78f6b9e0684e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.992897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6c0681f-919d-4861-8362-78f6b9e0684e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.994576] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6c0681f-919d-4861-8362-78f6b9e0684e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.994576] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6c0681f-919d-4861-8362-78f6b9e0684e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.331273] env[66834]: INFO networking_nsxv3.common.synchronization [req-6235cbde-22a6-4c1b-a01e-456dca546b57 req-5146bdcd-f3c9-40f8-9b4d-9afb47004546 service nova] Enqueued Resource ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 with Priority: HIGHEST for action security_group_rules [ 591.331460] env[66834]: INFO networking_nsxv3.common.synchronization [req-6235cbde-22a6-4c1b-a01e-456dca546b57 req-5146bdcd-f3c9-40f8-9b4d-9afb47004546 service nova] Enqueued Resource ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 with Priority: HIGHEST for action security_group_members [ 591.331591] env[66834]: INFO networking_nsxv3.common.synchronization [req-6235cbde-22a6-4c1b-a01e-456dca546b57 req-5146bdcd-f3c9-40f8-9b4d-9afb47004546 service nova] Enqueued Resource ID: c005dc96-0384-4ce2-b550-164e1b0ab0cf with Priority: HIGHEST for action port [ 591.335216] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 with Priority: HIGHEST for action security_group_rules [ 591.335216] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 with Priority: HIGHEST for action security_group_members [ 591.335216] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c005dc96-0384-4ce2-b550-164e1b0ab0cf with Priority: HIGHEST for action port [ 591.335216] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b93eb01-51cc-4c25-b2fa-56b4a62620d3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.335216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.335216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.335216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.335216] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b93eb01-51cc-4c25-b2fa-56b4a62620d3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.335216] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.335216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.335216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.335216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.335216] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.335216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.335216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.335216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.335216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.335216] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b93eb01-51cc-4c25-b2fa-56b4a62620d3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.336554] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-c005dc96-0384-4ce2-b550-164e1b0ab0cf taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.336666] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c005dc96-0384-4ce2-b550-164e1b0ab0cf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.336777] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c005dc96-0384-4ce2-b550-164e1b0ab0cf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.336886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c005dc96-0384-4ce2-b550-164e1b0ab0cf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.336955] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c005dc96-0384-4ce2-b550-164e1b0ab0cf',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.452091] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.452364] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.452364] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.452529] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.452617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.452712] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9115622-9b53-4106-895d-803c18358d29 is going to be created. [ 591.485288] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.485587] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.485587] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.485698] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.485841] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.497668] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9115622-9b53-4106-895d-803c18358d29 in Status: UNINITIALIZED for 2s [ 591.497883] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c6c0681f-919d-4861-8362-78f6b9e0684e [ 591.498124] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.498258] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.498426] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.498519] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.498604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.498692] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c6c0681f-919d-4861-8362-78f6b9e0684e already deleted. [ 591.498769] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6c0681f-919d-4861-8362-78f6b9e0684e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.839314] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.839773] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.839773] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b93eb01-51cc-4c25-b2fa-56b4a62620d3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.840576] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c005dc96-0384-4ce2-b550-164e1b0ab0cf with status ACTIVE [ 591.840762] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.840881] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.840940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.841152] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.841235] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.841396] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.841714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.841714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.841714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.841879] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.842668] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.842668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.843280] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.844012] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.844012] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.844012] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c005dc96-0384-4ce2-b550-164e1b0ab0cf is going to be updated. [ 591.870687] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.870687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.870687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.870687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.870687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.870687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c005dc96-0384-4ce2-b550-164e1b0ab0cf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.346207] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b93eb01-51cc-4c25-b2fa-56b4a62620d3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.501561] env[66834]: INFO networking_nsxv3.common.synchronization [req-845638f9-c7a4-41c0-b25b-f252433527fb req-2d047975-53e5-46c0-b42c-1db3d504e1da tempest-ServerDiagnosticsTest-1632880676 tempest-ServerDiagnosticsTest-1632880676-project-member] Enqueued Resource ID: 5a725faa-03fa-4615-b825-f2c19527a60c with Priority: HIGHEST for action security_group_members [ 592.501868] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a725faa-03fa-4615-b825-f2c19527a60c with Priority: HIGHEST for action security_group_members [ 592.502192] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a725faa-03fa-4615-b825-f2c19527a60c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.502318] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.502461] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.502616] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.502760] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.503234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.503234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.504313] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.504435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.504536] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a725faa-03fa-4615-b825-f2c19527a60c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.573640] env[66834]: INFO networking_nsxv3.common.synchronization [None req-52223711-9ef4-4168-9cb4-b81d89a7823e None None] Enqueued Resource ID: a35d4efb-ea02-4be2-95f7-65db47efc0bd with Priority: HIGHEST for action port [ 592.573640] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a35d4efb-ea02-4be2-95f7-65db47efc0bd with Priority: HIGHEST for action port [ 592.573640] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-a35d4efb-ea02-4be2-95f7-65db47efc0bd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.573640] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a35d4efb-ea02-4be2-95f7-65db47efc0bd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.573640] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a35d4efb-ea02-4be2-95f7-65db47efc0bd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.573842] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a35d4efb-ea02-4be2-95f7-65db47efc0bd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.574516] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a35d4efb-ea02-4be2-95f7-65db47efc0bd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.852607] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.852607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.852906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.853352] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.853352] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.853352] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 is going to be created. [ 592.883734] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.883905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.883970] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.884263] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.884366] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.896393] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 in Status: UNINITIALIZED for 2s [ 592.901858] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-582 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.904114] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.904349] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.904641] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.905621] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.905879] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.906088] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.906630] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.906630] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.907500] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 592.907500] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 592.907704] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 592.908083] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 592.908507] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 592.908507] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 592.908607] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 592.930951] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 592.930951] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 592.930951] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 592.930951] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.931174] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-daa7af1f-a8c9-4672-af15-08f2df748814 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.931174] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-daa7af1f-a8c9-4672-af15-08f2df748814" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.931284] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-daa7af1f-a8c9-4672-af15-08f2df748814" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.931573] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-daa7af1f-a8c9-4672-af15-08f2df748814" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.931705] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('daa7af1f-a8c9-4672-af15-08f2df748814',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.006965] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.007201] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.007275] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.007484] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.007573] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.007818] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.007890] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.007925] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.008460] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.008553] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.008647] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a725faa-03fa-4615-b825-f2c19527a60c already deleted. [ 593.008731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.080376] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a35d4efb-ea02-4be2-95f7-65db47efc0bd [ 593.080637] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.080782] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.080851] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.081084] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.081188] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.081283] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a35d4efb-ea02-4be2-95f7-65db47efc0bd already deleted. [ 593.081363] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a35d4efb-ea02-4be2-95f7-65db47efc0bd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.360050] env[66834]: INFO networking_nsxv3.common.synchronization [None req-bb5881ae-9aaa-4521-af77-1ed33126b97e None None] Enqueued Resource ID: 0333f80d-de28-4084-b016-0bb6e1f1bc39 with Priority: HIGHEST for action port [ 593.360791] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0333f80d-de28-4084-b016-0bb6e1f1bc39 with Priority: HIGHEST for action port [ 593.361400] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-0333f80d-de28-4084-b016-0bb6e1f1bc39 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.361537] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0333f80d-de28-4084-b016-0bb6e1f1bc39" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.361631] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0333f80d-de28-4084-b016-0bb6e1f1bc39" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.361885] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0333f80d-de28-4084-b016-0bb6e1f1bc39" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.363044] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0333f80d-de28-4084-b016-0bb6e1f1bc39',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.434238] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.435414] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.436351] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.436593] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.436749] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.437741] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port daa7af1f-a8c9-4672-af15-08f2df748814 not found, creating... [ 593.437741] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.437741] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.437741] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.438024] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.438063] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.438746] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.438746] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.438746] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.438931] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.439164] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.439308] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: daa7af1f-a8c9-4672-af15-08f2df748814 is going to be created. [ 593.465669] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.465892] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.466016] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.466281] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.466590] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.466823] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-daa7af1f-a8c9-4672-af15-08f2df748814" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.508518] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9115622-9b53-4106-895d-803c18358d29 in Status: SUCCESS [ 593.508743] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.508904] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.509409] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.509652] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.509795] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.509845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.509998] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.510084] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.510167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.510250] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9115622-9b53-4106-895d-803c18358d29',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.643400] env[66834]: INFO networking_nsxv3.common.synchronization [None req-90620c98-d75b-4715-8e10-848ff2c25e9b None None] Enqueued Resource ID: 1e250b6d-fbb9-481e-935f-9fcec1de176c with Priority: HIGHEST for action port [ 593.644052] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e250b6d-fbb9-481e-935f-9fcec1de176c with Priority: HIGHEST for action port [ 593.644285] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e250b6d-fbb9-481e-935f-9fcec1de176c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.644487] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e250b6d-fbb9-481e-935f-9fcec1de176c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.644559] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e250b6d-fbb9-481e-935f-9fcec1de176c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.644811] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e250b6d-fbb9-481e-935f-9fcec1de176c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.644895] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e250b6d-fbb9-481e-935f-9fcec1de176c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.865939] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0333f80d-de28-4084-b016-0bb6e1f1bc39 [ 593.866288] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.866356] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.866427] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.866632] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.866719] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.866812] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0333f80d-de28-4084-b016-0bb6e1f1bc39 already deleted. [ 593.866907] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0333f80d-de28-4084-b016-0bb6e1f1bc39" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.014020] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9115622-9b53-4106-895d-803c18358d29 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.014020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.014020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.014020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.014020] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.014020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.014020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.014020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.014020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.014020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.014438] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9115622-9b53-4106-895d-803c18358d29 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.014438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.014438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.014438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.014569] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.014569] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.014637] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.014744] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.014815] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.014891] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.014974] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9115622-9b53-4106-895d-803c18358d29',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.146781] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e250b6d-fbb9-481e-935f-9fcec1de176c [ 594.147052] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.147189] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.147259] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.147473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.147552] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.147646] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e250b6d-fbb9-481e-935f-9fcec1de176c already deleted. [ 594.147727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e250b6d-fbb9-481e-935f-9fcec1de176c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.176834] env[66834]: INFO networking_nsxv3.common.synchronization [req-845638f9-c7a4-41c0-b25b-f252433527fb req-cbb5c168-0724-460b-ba77-593195111a62 service nova] Enqueued Resource ID: 5a725faa-03fa-4615-b825-f2c19527a60c with Priority: HIGHEST for action security_group_rules [ 594.177092] env[66834]: INFO networking_nsxv3.common.synchronization [req-845638f9-c7a4-41c0-b25b-f252433527fb req-cbb5c168-0724-460b-ba77-593195111a62 service nova] Enqueued Resource ID: 5a725faa-03fa-4615-b825-f2c19527a60c with Priority: HIGHEST for action security_group_members [ 594.177092] env[66834]: INFO networking_nsxv3.common.synchronization [req-845638f9-c7a4-41c0-b25b-f252433527fb req-cbb5c168-0724-460b-ba77-593195111a62 service nova] Enqueued Resource ID: daa7af1f-a8c9-4672-af15-08f2df748814 with Priority: HIGHEST for action port [ 594.178264] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a725faa-03fa-4615-b825-f2c19527a60c with Priority: HIGHEST for action security_group_rules [ 594.178651] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a725faa-03fa-4615-b825-f2c19527a60c with Priority: HIGHEST for action security_group_members [ 594.178651] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daa7af1f-a8c9-4672-af15-08f2df748814 with Priority: HIGHEST for action port [ 594.178793] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a725faa-03fa-4615-b825-f2c19527a60c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.179054] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.179054] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.179199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.179269] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a725faa-03fa-4615-b825-f2c19527a60c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.180596] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a725faa-03fa-4615-b825-f2c19527a60c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.180816] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.180816] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.180938] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.181101] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.181193] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.181253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.181391] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.181473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.181558] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a725faa-03fa-4615-b825-f2c19527a60c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.182317] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-daa7af1f-a8c9-4672-af15-08f2df748814 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.182421] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-daa7af1f-a8c9-4672-af15-08f2df748814" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.182485] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-daa7af1f-a8c9-4672-af15-08f2df748814" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.182628] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-daa7af1f-a8c9-4672-af15-08f2df748814" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.182700] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('daa7af1f-a8c9-4672-af15-08f2df748814',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.392669] env[66834]: INFO networking_nsxv3.common.synchronization [None req-fdb4bc5a-73bb-4eca-a80f-85502f32c491 None None] Enqueued Resource ID: adec9c69-450c-4139-8c3b-899f48dbdde0 with Priority: HIGHEST for action port [ 594.396534] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adec9c69-450c-4139-8c3b-899f48dbdde0 with Priority: HIGHEST for action port [ 594.399896] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-adec9c69-450c-4139-8c3b-899f48dbdde0 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.400253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adec9c69-450c-4139-8c3b-899f48dbdde0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.400253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adec9c69-450c-4139-8c3b-899f48dbdde0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.400456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adec9c69-450c-4139-8c3b-899f48dbdde0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.400564] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adec9c69-450c-4139-8c3b-899f48dbdde0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.517505] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9115622-9b53-4106-895d-803c18358d29: rpc.has_security_group_logging(os_id): False [ 594.540577] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.540737] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.540821] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.541065] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.541160] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.541381] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.541482] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.541608] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.541778] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.541856] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.542064] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.542239] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.542297] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.542441] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.542513] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.542706] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.542796] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.542848] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.542986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.544250] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.544250] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9115622-9b53-4106-895d-803c18358d29 is going to be created. [ 594.608781] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.608781] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.608781] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.608781] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.608781] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.614819] env[66834]: INFO networking_nsxv3.common.synchronization [req-c1f89fed-385d-43e7-ab13-370cc47ff3ca req-7f74dffd-f1bb-4d96-befc-78c6fab739cf tempest-ServerDiagnosticsNegativeTest-1078775155 tempest-ServerDiagnosticsNegativeTest-1078775155-project-member] Enqueued Resource ID: 8ef26513-917e-4754-b69d-1d511bcb585b with Priority: HIGHEST for action security_group_members [ 594.615612] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ef26513-917e-4754-b69d-1d511bcb585b with Priority: HIGHEST for action security_group_members [ 594.618305] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ef26513-917e-4754-b69d-1d511bcb585b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.618305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.618305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.618305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.618305] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.618305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.618305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.618305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.618305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.618305] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ef26513-917e-4754-b69d-1d511bcb585b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.625495] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9115622-9b53-4106-895d-803c18358d29 in Status: IN_PROGRESS for 2s [ 594.684727] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a725faa-03fa-4615-b825-f2c19527a60c taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.684968] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.689050] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a725faa-03fa-4615-b825-f2c19527a60c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.690364] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port daa7af1f-a8c9-4672-af15-08f2df748814 with status ACTIVE [ 594.690859] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.690859] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.690859] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.691208] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.691287] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.691504] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.691629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.691696] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.691907] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.692009] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.692296] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.692422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.692504] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.692794] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.692889] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.692983] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: daa7af1f-a8c9-4672-af15-08f2df748814 is going to be updated. [ 594.725884] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.725884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.725884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.725884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.726318] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.726318] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-daa7af1f-a8c9-4672-af15-08f2df748814" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.903717] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port adec9c69-450c-4139-8c3b-899f48dbdde0 [ 594.904040] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.904288] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.904526] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.904927] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.905158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.905463] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:adec9c69-450c-4139-8c3b-899f48dbdde0 already deleted. [ 594.905731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adec9c69-450c-4139-8c3b-899f48dbdde0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.909283] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 in Status: SUCCESS [ 594.910265] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.910265] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.910265] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.910415] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.910530] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.910597] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.911023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.911023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.911023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.911023] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b93eb01-51cc-4c25-b2fa-56b4a62620d3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.051102] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-582 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.052516] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.052656] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.052941] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.053235] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.053398] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.053507] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.053810] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.053849] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.054082] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.054167] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 595.054271] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 595.054376] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 595.054479] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.054578] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 595.054704] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 595.075693] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 595.075860] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 595.075981] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 595.076244] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.076699] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-21c1be5c-d3f6-4307-8a37-ad6bfeda3213 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.076951] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-21c1be5c-d3f6-4307-8a37-ad6bfeda3213" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.077165] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-21c1be5c-d3f6-4307-8a37-ad6bfeda3213" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.077517] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-21c1be5c-d3f6-4307-8a37-ad6bfeda3213" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.077651] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21c1be5c-d3f6-4307-8a37-ad6bfeda3213',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.119764] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.119976] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.120081] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.120406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.120575] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.120811] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.120926] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.120985] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.121149] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.121220] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.121308] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ef26513-917e-4754-b69d-1d511bcb585b already deleted. [ 595.121379] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.195573] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a725faa-03fa-4615-b825-f2c19527a60c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.413509] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.413672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.414428] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.414428] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.414428] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.414428] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.414428] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.414428] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.414721] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.414721] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.414721] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.414979] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.414979] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.415083] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.415158] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.415247] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.415305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.415729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.415729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.415729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.415729] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b93eb01-51cc-4c25-b2fa-56b4a62620d3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.581301] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.581301] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.581301] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.582172] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.582172] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.582172] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 21c1be5c-d3f6-4307-8a37-ad6bfeda3213 not found, creating... [ 595.582817] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.582958] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.583196] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.583666] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.584469] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.584469] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.584469] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.584753] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.586188] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.586461] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.586747] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 21c1be5c-d3f6-4307-8a37-ad6bfeda3213 is going to be created. [ 595.608900] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.608900] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.608900] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.608900] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.608900] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.608900] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-21c1be5c-d3f6-4307-8a37-ad6bfeda3213" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.700372] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.700533] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.700604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.700807] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.700893] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.700986] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a725faa-03fa-4615-b825-f2c19527a60c is going to be created. [ 595.744133] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.744355] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.744399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.744664] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.744874] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.758910] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a725faa-03fa-4615-b825-f2c19527a60c in Status: UNINITIALIZED for 2s [ 595.803867] env[66834]: INFO networking_nsxv3.common.synchronization [None req-fbcdd609-c410-4d68-b307-aeab7736c3ad tempest-ServerActionsTestJSON-2105447671 tempest-ServerActionsTestJSON-2105447671-project-member] Enqueued Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_rules [ 595.804282] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_rules [ 595.804574] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b33fa48-b9ca-426c-b890-67d4639035e2 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.804695] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.804763] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.805959] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.806101] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.925701] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b93eb01-51cc-4c25-b2fa-56b4a62620d3: rpc.has_security_group_logging(os_id): False [ 595.926937] env[66834]: INFO networking_nsxv3.common.synchronization [None req-1d672de3-2648-4592-9866-cf22c64be3a2 tempest-ServerActionsTestJSON-2105447671 tempest-ServerActionsTestJSON-2105447671-project-member] Enqueued Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_rules [ 595.927498] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_rules [ 595.927962] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b33fa48-b9ca-426c-b890-67d4639035e2 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.928130] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.947543] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.947696] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.947767] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.948108] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.948235] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.948452] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.948555] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.948616] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.948782] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.949385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.949385] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.949385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.949385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.949792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.949792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.949792] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.949900] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.949900] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.950009] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.950081] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.950163] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 is going to be created. [ 596.008801] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.008958] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.010042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.010042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.010042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.022081] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 in Status: IN_PROGRESS for 2s [ 596.341151] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.341342] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.341438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.341809] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.341962] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.342310] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 already deleted. [ 596.342310] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.342491] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.342745] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.342877] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.355837] env[66834]: INFO networking_nsxv3.common.synchronization [req-c1f89fed-385d-43e7-ab13-370cc47ff3ca req-d6c39668-f2ac-441b-8e56-cc840e625fd1 service nova] Enqueued Resource ID: 8ef26513-917e-4754-b69d-1d511bcb585b with Priority: HIGHEST for action security_group_rules [ 596.356234] env[66834]: INFO networking_nsxv3.common.synchronization [req-c1f89fed-385d-43e7-ab13-370cc47ff3ca req-d6c39668-f2ac-441b-8e56-cc840e625fd1 service nova] Enqueued Resource ID: 8ef26513-917e-4754-b69d-1d511bcb585b with Priority: HIGHEST for action security_group_members [ 596.356234] env[66834]: INFO networking_nsxv3.common.synchronization [req-c1f89fed-385d-43e7-ab13-370cc47ff3ca req-d6c39668-f2ac-441b-8e56-cc840e625fd1 service nova] Enqueued Resource ID: 21c1be5c-d3f6-4307-8a37-ad6bfeda3213 with Priority: HIGHEST for action port [ 596.356718] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ef26513-917e-4754-b69d-1d511bcb585b with Priority: HIGHEST for action security_group_rules [ 596.356914] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ef26513-917e-4754-b69d-1d511bcb585b with Priority: HIGHEST for action security_group_members [ 596.356950] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21c1be5c-d3f6-4307-8a37-ad6bfeda3213 with Priority: HIGHEST for action port [ 596.357816] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ef26513-917e-4754-b69d-1d511bcb585b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.357816] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.357816] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.357816] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.357816] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ef26513-917e-4754-b69d-1d511bcb585b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.358730] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ef26513-917e-4754-b69d-1d511bcb585b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.358882] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.358918] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.359105] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.359265] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.359405] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.359507] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.359604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.360292] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.360292] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ef26513-917e-4754-b69d-1d511bcb585b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.360857] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-21c1be5c-d3f6-4307-8a37-ad6bfeda3213 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.360972] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21c1be5c-d3f6-4307-8a37-ad6bfeda3213" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.361036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21c1be5c-d3f6-4307-8a37-ad6bfeda3213" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.361806] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21c1be5c-d3f6-4307-8a37-ad6bfeda3213" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.361806] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21c1be5c-d3f6-4307-8a37-ad6bfeda3213',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.638563] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9115622-9b53-4106-895d-803c18358d29 in Status: SUCCESS [ 596.639817] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.717453] env[66834]: INFO networking_nsxv3.common.synchronization [None req-932c9f22-b747-46b5-bb1c-519485e8f4b7 None None] Enqueued Resource ID: 9dc446f2-fd38-4884-b279-09ed25748af2 with Priority: HIGHEST for action port [ 596.718219] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dc446f2-fd38-4884-b279-09ed25748af2 with Priority: HIGHEST for action port [ 596.718619] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-9dc446f2-fd38-4884-b279-09ed25748af2 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.718700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9dc446f2-fd38-4884-b279-09ed25748af2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.718736] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9dc446f2-fd38-4884-b279-09ed25748af2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.718992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9dc446f2-fd38-4884-b279-09ed25748af2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.719106] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dc446f2-fd38-4884-b279-09ed25748af2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.789581] env[66834]: INFO networking_nsxv3.common.synchronization [None req-5e101fde-9561-430b-9870-122d25070cec tempest-VolumesAssistedSnapshotsTest-105506614 tempest-VolumesAssistedSnapshotsTest-105506614-project-member] Enqueued Resource ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 with Priority: HIGHEST for action security_group_rules [ 596.790078] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 with Priority: HIGHEST for action security_group_rules [ 596.790693] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-386f2bfa-81a7-40ba-a9a8-a207890c2528 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.790821] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.790887] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.791145] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.791221] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('386f2bfa-81a7-40ba-a9a8-a207890c2528',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.863053] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ef26513-917e-4754-b69d-1d511bcb585b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.863208] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.864078] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8ef26513-917e-4754-b69d-1d511bcb585b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.864403] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21c1be5c-d3f6-4307-8a37-ad6bfeda3213 with status ACTIVE [ 596.864465] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.864528] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.864592] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.864829] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.864866] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.865048] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.865148] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.865264] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.865356] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.865428] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.865605] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.865688] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.865745] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.865875] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.865941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.866114] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21c1be5c-d3f6-4307-8a37-ad6bfeda3213 is going to be updated. [ 596.869183] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.869308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.869347] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.869685] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.869685] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.869685] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 already deleted. [ 596.869852] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.899602] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.899688] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.900039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.900039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.900140] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.900251] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21c1be5c-d3f6-4307-8a37-ad6bfeda3213" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.932813] env[66834]: INFO networking_nsxv3.common.synchronization [None req-f017c80a-61c5-4484-9688-774d6af21e28 tempest-VolumesAssistedSnapshotsTest-105506614 tempest-VolumesAssistedSnapshotsTest-105506614-project-member] Enqueued Resource ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 with Priority: HIGHEST for action security_group_rules [ 596.936258] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 with Priority: HIGHEST for action security_group_rules [ 596.936258] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-386f2bfa-81a7-40ba-a9a8-a207890c2528 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.936258] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.221850] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9dc446f2-fd38-4884-b279-09ed25748af2 [ 597.222115] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.222258] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.222326] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.222548] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.222761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.222761] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9dc446f2-fd38-4884-b279-09ed25748af2 already deleted. [ 597.222858] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9dc446f2-fd38-4884-b279-09ed25748af2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.313286] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.313445] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.313514] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.313731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.313825] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.313928] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 already deleted. [ 597.313999] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.314193] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.314353] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.314438] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('386f2bfa-81a7-40ba-a9a8-a207890c2528',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.369314] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8ef26513-917e-4754-b69d-1d511bcb585b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.771796] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a725faa-03fa-4615-b825-f2c19527a60c in Status: SUCCESS [ 597.771918] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.772096] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.772320] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.772514] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.773057] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.773057] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.773057] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.773244] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.773244] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.773634] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a725faa-03fa-4615-b825-f2c19527a60c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.837600] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.837761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.837828] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.840138] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.840138] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.840138] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 already deleted. [ 597.840138] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.871838] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.872059] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.872255] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.872352] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.872459] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.872518] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ef26513-917e-4754-b69d-1d511bcb585b is going to be created. [ 597.897944] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.897944] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.897944] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.898427] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.898427] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.909086] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ef26513-917e-4754-b69d-1d511bcb585b in Status: UNINITIALIZED for 2s [ 598.036497] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 in Status: SUCCESS [ 598.036497] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.229318] env[66834]: INFO networking_nsxv3.common.synchronization [None req-0569dc86-eafd-4ae0-ad41-d59fe093fed7 None None] Enqueued Resource ID: 6c0609e8-b206-4c8b-b619-d0efd373c606 with Priority: HIGHEST for action port [ 598.229964] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c0609e8-b206-4c8b-b619-d0efd373c606 with Priority: HIGHEST for action port [ 598.230365] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c0609e8-b206-4c8b-b619-d0efd373c606 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.230503] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c0609e8-b206-4c8b-b619-d0efd373c606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.230573] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c0609e8-b206-4c8b-b619-d0efd373c606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.230870] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c0609e8-b206-4c8b-b619-d0efd373c606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.230870] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c0609e8-b206-4c8b-b619-d0efd373c606',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.280023] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a725faa-03fa-4615-b825-f2c19527a60c taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.280023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.280023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.280023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.280023] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.280023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.280023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.280023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.280023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.280023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.280023] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a725faa-03fa-4615-b825-f2c19527a60c taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.280023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.280023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.280023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.280023] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.280023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.280800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.280800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.280800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.280800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.280800] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a725faa-03fa-4615-b825-f2c19527a60c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.732938] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c0609e8-b206-4c8b-b619-d0efd373c606 [ 598.733226] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.733386] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.733428] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.733644] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.733735] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.733827] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c0609e8-b206-4c8b-b619-d0efd373c606 already deleted. [ 598.733906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c0609e8-b206-4c8b-b619-d0efd373c606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.784821] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a725faa-03fa-4615-b825-f2c19527a60c: rpc.has_security_group_logging(os_id): False [ 598.804800] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.804800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.804800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.804800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.804800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.805174] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.805174] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.805264] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.805379] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.805473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.805709] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.805866] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.805866] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.806037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.806112] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.806322] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.806415] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.806478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.806622] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.806714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.806803] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a725faa-03fa-4615-b825-f2c19527a60c is going to be created. [ 598.885360] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.885551] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.885551] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.885963] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.885963] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.898036] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a725faa-03fa-4615-b825-f2c19527a60c in Status: IN_PROGRESS for 2s [ 599.805477] env[66834]: INFO networking_nsxv3.common.synchronization [req-4b2e90e2-ccff-46c5-9014-f82014947d2d req-c85daf66-bb3f-43e1-9e58-1e77ddd039df tempest-InstanceActionsTestJSON-2076877083 tempest-InstanceActionsTestJSON-2076877083-project-member] Enqueued Resource ID: 659c3ecb-b49f-4d7f-8978-4e0221530e96 with Priority: HIGHEST for action security_group_members [ 599.806350] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 659c3ecb-b49f-4d7f-8978-4e0221530e96 with Priority: HIGHEST for action security_group_members [ 599.807481] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-659c3ecb-b49f-4d7f-8978-4e0221530e96 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.807895] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.807895] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.808020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.808266] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.808387] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.808451] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.808634] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.808721] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.808936] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('659c3ecb-b49f-4d7f-8978-4e0221530e96',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.921731] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ef26513-917e-4754-b69d-1d511bcb585b in Status: SUCCESS [ 599.921731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.921731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.921957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.921957] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.922107] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.922165] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.922375] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.922409] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.922482] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.922562] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8ef26513-917e-4754-b69d-1d511bcb585b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.229605] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-817 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.229787] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-817" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.229907] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-817" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.230259] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-817" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.230572] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.230744] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.230880] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.231248] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.231332] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.231569] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 600.231694] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 600.231800] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 600.231930] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 600.232286] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 600.232286] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 600.232385] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 600.256241] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 600.256410] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 600.256537] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 600.256719] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-817" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.257052] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-2aabf079-5a9f-46a7-a3a6-c660b62a574a taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.257303] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-2aabf079-5a9f-46a7-a3a6-c660b62a574a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.257478] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-2aabf079-5a9f-46a7-a3a6-c660b62a574a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.257772] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-2aabf079-5a9f-46a7-a3a6-c660b62a574a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.257901] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2aabf079-5a9f-46a7-a3a6-c660b62a574a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.312091] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.312261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.312353] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.312563] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.312653] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.312840] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.313136] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.313136] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.313235] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.313235] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.313328] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 659c3ecb-b49f-4d7f-8978-4e0221530e96 already deleted. [ 600.313411] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.429234] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ef26513-917e-4754-b69d-1d511bcb585b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.429234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.429234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.429234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.429234] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.429234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.429234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.429234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.429234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.429234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.429234] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ef26513-917e-4754-b69d-1d511bcb585b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.429234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.429234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.429234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.429234] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.429234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.429784] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.429784] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.429784] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.429784] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.429784] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8ef26513-917e-4754-b69d-1d511bcb585b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.761235] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.761235] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.761594] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.762553] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.762553] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.762553] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 2aabf079-5a9f-46a7-a3a6-c660b62a574a not found, creating... [ 600.762933] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.763293] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.764670] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.764670] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.764670] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.764670] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.765095] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.765348] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.765674] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.765907] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.766169] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 2aabf079-5a9f-46a7-a3a6-c660b62a574a is going to be created. [ 600.793056] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.793056] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.793056] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.793414] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.793581] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.793874] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-2aabf079-5a9f-46a7-a3a6-c660b62a574a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.930336] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a725faa-03fa-4615-b825-f2c19527a60c in Status: SUCCESS [ 600.930797] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.932098] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8ef26513-917e-4754-b69d-1d511bcb585b: rpc.has_security_group_logging(os_id): False [ 600.953160] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.953160] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.953160] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.953414] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.953552] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.953864] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.954013] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.954088] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.954315] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.954389] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.954612] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.954779] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.954875] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.955068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.955168] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.955374] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.955517] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.955641] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.955852] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.955972] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.956141] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ef26513-917e-4754-b69d-1d511bcb585b is going to be created. [ 601.032930] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.033233] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.033324] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.033553] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.034056] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.046893] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ef26513-917e-4754-b69d-1d511bcb585b in Status: IN_PROGRESS for 2s [ 601.483104] env[66834]: INFO networking_nsxv3.common.synchronization [req-4b2e90e2-ccff-46c5-9014-f82014947d2d req-bbf5c26a-ca4f-427f-92f6-783ec59d7307 service nova] Enqueued Resource ID: 659c3ecb-b49f-4d7f-8978-4e0221530e96 with Priority: HIGHEST for action security_group_rules [ 601.483284] env[66834]: INFO networking_nsxv3.common.synchronization [req-4b2e90e2-ccff-46c5-9014-f82014947d2d req-bbf5c26a-ca4f-427f-92f6-783ec59d7307 service nova] Enqueued Resource ID: 659c3ecb-b49f-4d7f-8978-4e0221530e96 with Priority: HIGHEST for action security_group_members [ 601.483437] env[66834]: INFO networking_nsxv3.common.synchronization [req-4b2e90e2-ccff-46c5-9014-f82014947d2d req-bbf5c26a-ca4f-427f-92f6-783ec59d7307 service nova] Enqueued Resource ID: 2aabf079-5a9f-46a7-a3a6-c660b62a574a with Priority: HIGHEST for action port [ 601.483669] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 659c3ecb-b49f-4d7f-8978-4e0221530e96 with Priority: HIGHEST for action security_group_rules [ 601.483793] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 659c3ecb-b49f-4d7f-8978-4e0221530e96 with Priority: HIGHEST for action security_group_members [ 601.483888] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aabf079-5a9f-46a7-a3a6-c660b62a574a with Priority: HIGHEST for action port [ 601.484498] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-659c3ecb-b49f-4d7f-8978-4e0221530e96 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.484639] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.484917] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.485073] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.485073] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('659c3ecb-b49f-4d7f-8978-4e0221530e96',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.486486] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-659c3ecb-b49f-4d7f-8978-4e0221530e96 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.486669] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.486789] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.487075] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.487313] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.487434] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.487504] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.487644] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.487731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.487820] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('659c3ecb-b49f-4d7f-8978-4e0221530e96',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.488572] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-2aabf079-5a9f-46a7-a3a6-c660b62a574a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.488697] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2aabf079-5a9f-46a7-a3a6-c660b62a574a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.488757] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2aabf079-5a9f-46a7-a3a6-c660b62a574a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.489033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2aabf079-5a9f-46a7-a3a6-c660b62a574a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.489033] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2aabf079-5a9f-46a7-a3a6-c660b62a574a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.992154] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('659c3ecb-b49f-4d7f-8978-4e0221530e96',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.993793] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-659c3ecb-b49f-4d7f-8978-4e0221530e96 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.993951] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.994215] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2aabf079-5a9f-46a7-a3a6-c660b62a574a with status ACTIVE [ 601.994357] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.994357] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.994471] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.994610] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.994699] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.994859] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.994953] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.995021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.995208] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.995315] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.995627] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.995627] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.995773] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.995863] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.995958] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.996215] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2aabf079-5a9f-46a7-a3a6-c660b62a574a is going to be updated. [ 602.019899] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.020523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.020523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.020523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.020523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.020887] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2aabf079-5a9f-46a7-a3a6-c660b62a574a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.143187] env[66834]: INFO networking_nsxv3.common.synchronization [req-81ef7ea6-72cd-4e1d-93e8-a8c031ed8168 req-34297667-db26-40dd-82ba-fa65e9785f93 tempest-ImagesNegativeTestJSON-1790257005 tempest-ImagesNegativeTestJSON-1790257005-project-member] Enqueued Resource ID: cb6f8ce6-311d-4e8e-b179-b86a971739cb with Priority: HIGHEST for action security_group_members [ 602.143742] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb6f8ce6-311d-4e8e-b179-b86a971739cb with Priority: HIGHEST for action security_group_members [ 602.144060] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb6f8ce6-311d-4e8e-b179-b86a971739cb taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.144185] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.144252] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.144505] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.144660] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.144778] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.144843] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.144998] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.145133] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.145229] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb6f8ce6-311d-4e8e-b179-b86a971739cb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.473354] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-722 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.473547] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-722" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.473665] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-722" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.473973] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-722" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.474965] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.474965] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.474965] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.474965] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.475273] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.475385] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.475423] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 602.475519] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 602.475614] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 602.475732] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.475828] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 602.475945] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 602.495385] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 602.495583] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 602.495720] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 602.495887] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-722" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.496207] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-42f7117f-203c-4053-99a2-3597969a74e6 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.496526] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-42f7117f-203c-4053-99a2-3597969a74e6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.496526] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-42f7117f-203c-4053-99a2-3597969a74e6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.496841] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-42f7117f-203c-4053-99a2-3597969a74e6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.497019] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42f7117f-203c-4053-99a2-3597969a74e6',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.498079] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('659c3ecb-b49f-4d7f-8978-4e0221530e96',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.647064] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.647500] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.647500] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.647578] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.647668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.649435] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.649435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.649435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.649435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.649435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.649435] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb6f8ce6-311d-4e8e-b179-b86a971739cb already deleted. [ 602.649435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.003019] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.003019] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.003019] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.003019] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.003019] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.003019] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 42f7117f-203c-4053-99a2-3597969a74e6 not found, creating... [ 603.003019] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.003019] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.003019] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.003019] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.003019] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.003656] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.003656] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.003656] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.003656] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.003656] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.003656] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 42f7117f-203c-4053-99a2-3597969a74e6 is going to be created. [ 603.007304] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.008305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.009025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.009025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.009025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.009025] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 659c3ecb-b49f-4d7f-8978-4e0221530e96 is going to be created. [ 603.030926] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.031407] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.031607] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.031940] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.032384] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.032707] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-42f7117f-203c-4053-99a2-3597969a74e6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.034588] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.035243] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.035243] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.035243] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.035243] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.045817] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 659c3ecb-b49f-4d7f-8978-4e0221530e96 in Status: UNINITIALIZED for 2s [ 603.063671] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ef26513-917e-4754-b69d-1d511bcb585b in Status: SUCCESS [ 603.063932] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.745411] env[66834]: INFO networking_nsxv3.common.synchronization [req-81ef7ea6-72cd-4e1d-93e8-a8c031ed8168 req-9096e498-d740-4211-a571-e44ae22c2571 service nova] Enqueued Resource ID: cb6f8ce6-311d-4e8e-b179-b86a971739cb with Priority: HIGHEST for action security_group_rules [ 603.745589] env[66834]: INFO networking_nsxv3.common.synchronization [req-81ef7ea6-72cd-4e1d-93e8-a8c031ed8168 req-9096e498-d740-4211-a571-e44ae22c2571 service nova] Enqueued Resource ID: cb6f8ce6-311d-4e8e-b179-b86a971739cb with Priority: HIGHEST for action security_group_members [ 603.747362] env[66834]: INFO networking_nsxv3.common.synchronization [req-81ef7ea6-72cd-4e1d-93e8-a8c031ed8168 req-9096e498-d740-4211-a571-e44ae22c2571 service nova] Enqueued Resource ID: 42f7117f-203c-4053-99a2-3597969a74e6 with Priority: HIGHEST for action port [ 603.748249] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb6f8ce6-311d-4e8e-b179-b86a971739cb with Priority: HIGHEST for action security_group_rules [ 603.749351] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb6f8ce6-311d-4e8e-b179-b86a971739cb with Priority: HIGHEST for action security_group_members [ 603.749532] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42f7117f-203c-4053-99a2-3597969a74e6 with Priority: HIGHEST for action port [ 603.749844] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb6f8ce6-311d-4e8e-b179-b86a971739cb taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.750144] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.750399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.753380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.753380] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb6f8ce6-311d-4e8e-b179-b86a971739cb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.753380] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb6f8ce6-311d-4e8e-b179-b86a971739cb taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.753380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.753380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.753380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.753380] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.753380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.753380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.753380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.753380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.753380] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb6f8ce6-311d-4e8e-b179-b86a971739cb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.754122] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-42f7117f-203c-4053-99a2-3597969a74e6 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.754250] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42f7117f-203c-4053-99a2-3597969a74e6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.754310] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42f7117f-203c-4053-99a2-3597969a74e6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.754452] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42f7117f-203c-4053-99a2-3597969a74e6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.754531] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42f7117f-203c-4053-99a2-3597969a74e6',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.256360] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb6f8ce6-311d-4e8e-b179-b86a971739cb taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.256360] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.263260] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42f7117f-203c-4053-99a2-3597969a74e6 with status ACTIVE [ 604.263260] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.263260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.263260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.263260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.263260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.263260] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.263260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.263260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.263260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.263260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.263260] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.263260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.263260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.263260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.263260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.263260] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42f7117f-203c-4053-99a2-3597969a74e6 is going to be updated. [ 604.264484] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb6f8ce6-311d-4e8e-b179-b86a971739cb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.289019] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.290055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.290055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.290055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.290055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.290055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42f7117f-203c-4053-99a2-3597969a74e6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.768361] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb6f8ce6-311d-4e8e-b179-b86a971739cb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.057663] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 659c3ecb-b49f-4d7f-8978-4e0221530e96 in Status: SUCCESS [ 605.057663] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.057800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.057921] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.058186] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.058344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.058406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.058571] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.058650] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.058733] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.058895] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('659c3ecb-b49f-4d7f-8978-4e0221530e96',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.271147] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.271596] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.271596] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.271596] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.271596] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.272132] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb6f8ce6-311d-4e8e-b179-b86a971739cb is going to be created. [ 605.301809] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.301809] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.301809] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.301809] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.301809] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.314419] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb6f8ce6-311d-4e8e-b179-b86a971739cb in Status: UNINITIALIZED for 2s [ 605.561162] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-659c3ecb-b49f-4d7f-8978-4e0221530e96 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.564151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.564151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.564151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.564151] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.564151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.564151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.564151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.564151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.564151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.564151] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-659c3ecb-b49f-4d7f-8978-4e0221530e96 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.564151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.564151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.564151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.564151] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.564151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.564151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.564151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.564151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.564814] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.564814] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('659c3ecb-b49f-4d7f-8978-4e0221530e96',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.071467] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 659c3ecb-b49f-4d7f-8978-4e0221530e96: rpc.has_security_group_logging(os_id): False [ 606.091200] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.091200] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.091200] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.091414] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.091490] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.091741] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.092780] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.092780] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.092780] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.092780] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.092780] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.093153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.093153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.093153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.093240] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.093485] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.093591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.093650] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.093847] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.093899] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.094021] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 659c3ecb-b49f-4d7f-8978-4e0221530e96 is going to be created. [ 606.162382] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.162524] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.162598] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.162885] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.163155] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.179335] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 659c3ecb-b49f-4d7f-8978-4e0221530e96 in Status: IN_PROGRESS for 2s [ 606.837972] env[66834]: INFO networking_nsxv3.common.synchronization [None req-2ff81cbd-9749-4a09-9b7c-1d957c9949a7 None None] Enqueued Resource ID: 1e33d263-8fe2-4c34-b53b-8f4876bd6816 with Priority: HIGHEST for action port [ 606.840358] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e33d263-8fe2-4c34-b53b-8f4876bd6816 with Priority: HIGHEST for action port [ 606.840762] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e33d263-8fe2-4c34-b53b-8f4876bd6816 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.840943] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e33d263-8fe2-4c34-b53b-8f4876bd6816" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.841032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e33d263-8fe2-4c34-b53b-8f4876bd6816" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.841351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e33d263-8fe2-4c34-b53b-8f4876bd6816" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.841476] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e33d263-8fe2-4c34-b53b-8f4876bd6816',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.180331] env[66834]: INFO networking_nsxv3.common.synchronization [req-5e7a56f2-7065-4097-af8f-4ee5a011e90e req-8c80171b-a9c9-4daf-8b2d-a12b6368ba45 tempest-ImagesOneServerNegativeTestJSON-1609959325 tempest-ImagesOneServerNegativeTestJSON-1609959325-project-member] Enqueued Resource ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 with Priority: HIGHEST for action security_group_members [ 607.180798] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 with Priority: HIGHEST for action security_group_members [ 607.181146] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.181241] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.181527] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.181617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.182147] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.182274] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.182335] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.182505] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.182586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.182681] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.327234] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb6f8ce6-311d-4e8e-b179-b86a971739cb in Status: SUCCESS [ 607.328633] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.328633] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.328633] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.329261] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.329261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.329261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.329397] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.329491] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.329525] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.329784] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb6f8ce6-311d-4e8e-b179-b86a971739cb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.345360] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e33d263-8fe2-4c34-b53b-8f4876bd6816 [ 607.345570] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.345702] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.345770] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.345968] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.346065] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.346154] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e33d263-8fe2-4c34-b53b-8f4876bd6816 already deleted. [ 607.346234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e33d263-8fe2-4c34-b53b-8f4876bd6816" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.588708] env[66834]: INFO networking_nsxv3.common.synchronization [req-1c547873-235b-4c9d-b592-5794ca5eb66c req-52a0c86a-f8ad-4a5f-a930-dedbb30e43c9 tempest-DeleteServersAdminTestJSON-1806332224 tempest-DeleteServersAdminTestJSON-1806332224-project-admin] Enqueued Resource ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 with Priority: HIGHEST for action security_group_members [ 607.590015] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 with Priority: HIGHEST for action security_group_members [ 607.590015] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.590015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.590015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.590379] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.590379] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.590458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.590458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.590627] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.590710] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.590805] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b93eb01-51cc-4c25-b2fa-56b4a62620d3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.615046] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-479 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.615270] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-479" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.616174] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-479" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.616174] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-479" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.616174] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.616431] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.616431] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.616642] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.616741] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.616922] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.617039] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 607.617250] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 607.617250] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 607.617363] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.617461] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 607.617587] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 607.639743] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 607.639922] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 607.640099] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 607.640289] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-479" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.640607] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-9dcad9a8-6566-4b84-a310-12f7b6257995 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.640778] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-9dcad9a8-6566-4b84-a310-12f7b6257995" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.640870] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-9dcad9a8-6566-4b84-a310-12f7b6257995" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.641222] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-9dcad9a8-6566-4b84-a310-12f7b6257995" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.641338] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dcad9a8-6566-4b84-a310-12f7b6257995',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.684458] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.684628] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.684694] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.684934] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.685039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.685241] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.685310] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.685345] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.685489] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.685565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.685649] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 already deleted. [ 607.685727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.831804] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb6f8ce6-311d-4e8e-b179-b86a971739cb taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.831939] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.831991] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.832783] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.833023] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.833117] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.833291] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.833509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.834437] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.834437] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.834437] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb6f8ce6-311d-4e8e-b179-b86a971739cb taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.834437] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.834437] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.834437] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.834437] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.834437] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.834437] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.834983] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.834983] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.834983] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.834983] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb6f8ce6-311d-4e8e-b179-b86a971739cb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.065175] env[66834]: INFO networking_nsxv3.common.synchronization [None req-e16c5603-26a3-4034-9cb5-85c62d4607cf tempest-ServersWithSpecificFlavorTestJSON-2029331566 tempest-ServersWithSpecificFlavorTestJSON-2029331566-project-member] Enqueued Resource ID: 9c3590f1-016a-4b00-b83e-f52f030b948b with Priority: HIGHEST for action security_group_rules [ 608.065175] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c3590f1-016a-4b00-b83e-f52f030b948b with Priority: HIGHEST for action security_group_rules [ 608.065175] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c3590f1-016a-4b00-b83e-f52f030b948b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.065175] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.065625] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.065625] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.065625] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c3590f1-016a-4b00-b83e-f52f030b948b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.095584] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.095584] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.095584] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.095584] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.095584] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.095584] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.095584] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.095584] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.095584] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.095584] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.095584] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 is going to be updated. [ 608.129564] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.129564] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.129564] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.129564] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.129564] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.141385] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 in Status: IN_PROGRESS for 2s [ 608.146136] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.146136] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.146317] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.147413] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.147413] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.147413] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 9dcad9a8-6566-4b84-a310-12f7b6257995 not found, creating... [ 608.148613] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.148613] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.148613] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.148891] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.148891] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.149190] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.150693] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.150693] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.150693] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.150693] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.150693] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 9dcad9a8-6566-4b84-a310-12f7b6257995 is going to be created. [ 608.191523] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.191761] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.191882] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.192187] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.192421] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.192643] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-9dcad9a8-6566-4b84-a310-12f7b6257995" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.195297] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 659c3ecb-b49f-4d7f-8978-4e0221530e96 in Status: SUCCESS [ 608.195535] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.338154] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb6f8ce6-311d-4e8e-b179-b86a971739cb: rpc.has_security_group_logging(os_id): False [ 608.369736] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.370019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.370019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.370219] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.370314] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.370537] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.370632] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.370689] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.370839] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.370913] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.371097] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.371190] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.371245] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.371379] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.371449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.371700] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.371700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.371820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.371895] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.372304] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.372304] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb6f8ce6-311d-4e8e-b179-b86a971739cb is going to be created. [ 608.485891] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.485891] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.486132] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.486262] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.486662] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.502076] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb6f8ce6-311d-4e8e-b179-b86a971739cb in Status: IN_PROGRESS for 2s [ 608.547925] env[66834]: INFO networking_nsxv3.common.synchronization [None req-53fddba5-bbab-4b0c-a108-48d9aa116fae tempest-ServersWithSpecificFlavorTestJSON-2029331566 tempest-ServersWithSpecificFlavorTestJSON-2029331566-project-member] Enqueued Resource ID: 9c3590f1-016a-4b00-b83e-f52f030b948b with Priority: HIGHEST for action security_group_rules [ 608.548651] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c3590f1-016a-4b00-b83e-f52f030b948b with Priority: HIGHEST for action security_group_rules [ 608.548949] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c3590f1-016a-4b00-b83e-f52f030b948b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.549174] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.589697] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.589900] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.589900] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.590191] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.590233] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.590331] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c3590f1-016a-4b00-b83e-f52f030b948b already deleted. [ 608.590407] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.590587] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.590707] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.590790] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c3590f1-016a-4b00-b83e-f52f030b948b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.895259] env[66834]: INFO networking_nsxv3.common.synchronization [req-5e7a56f2-7065-4097-af8f-4ee5a011e90e req-c9aead66-51ed-4b1b-a73c-1a694be8cdbe service nova] Enqueued Resource ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 with Priority: HIGHEST for action security_group_rules [ 608.895484] env[66834]: INFO networking_nsxv3.common.synchronization [req-5e7a56f2-7065-4097-af8f-4ee5a011e90e req-c9aead66-51ed-4b1b-a73c-1a694be8cdbe service nova] Enqueued Resource ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 with Priority: HIGHEST for action security_group_members [ 608.895644] env[66834]: INFO networking_nsxv3.common.synchronization [req-5e7a56f2-7065-4097-af8f-4ee5a011e90e req-c9aead66-51ed-4b1b-a73c-1a694be8cdbe service nova] Enqueued Resource ID: 9dcad9a8-6566-4b84-a310-12f7b6257995 with Priority: HIGHEST for action port [ 608.896128] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 with Priority: HIGHEST for action security_group_rules [ 608.896262] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 with Priority: HIGHEST for action security_group_members [ 608.896361] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dcad9a8-6566-4b84-a310-12f7b6257995 with Priority: HIGHEST for action port [ 608.896701] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.896784] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.896823] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.897385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.897385] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.898019] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.898140] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.898208] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.899036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.899036] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.899036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.899036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.899036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.899036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.899036] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.899983] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-9dcad9a8-6566-4b84-a310-12f7b6257995 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.899983] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9dcad9a8-6566-4b84-a310-12f7b6257995" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.899983] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9dcad9a8-6566-4b84-a310-12f7b6257995" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.900277] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9dcad9a8-6566-4b84-a310-12f7b6257995" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.900277] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dcad9a8-6566-4b84-a310-12f7b6257995',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.111922] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.112501] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.112501] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.112501] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.112501] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.112646] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c3590f1-016a-4b00-b83e-f52f030b948b already deleted. [ 609.112646] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.325750] env[66834]: INFO networking_nsxv3.common.synchronization [None req-8d7534dc-e440-4284-b30b-48a4efeb3f59 None None] Enqueued Resource ID: ff44f246-d9d7-4e42-b819-68687cceb347 with Priority: HIGHEST for action port [ 609.326269] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff44f246-d9d7-4e42-b819-68687cceb347 with Priority: HIGHEST for action port [ 609.326921] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff44f246-d9d7-4e42-b819-68687cceb347 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.328405] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff44f246-d9d7-4e42-b819-68687cceb347" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.328405] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff44f246-d9d7-4e42-b819-68687cceb347" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.328936] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff44f246-d9d7-4e42-b819-68687cceb347" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.329293] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff44f246-d9d7-4e42-b819-68687cceb347',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.403971] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.403971] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.404601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.405828] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9dcad9a8-6566-4b84-a310-12f7b6257995 with status ACTIVE [ 609.405828] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.405828] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.405828] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.405828] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.405828] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.405828] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.406082] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.406082] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.406632] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.406752] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.406944] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.408158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.408158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.408158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.408158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.408158] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9dcad9a8-6566-4b84-a310-12f7b6257995 is going to be updated. [ 609.431173] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.431342] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.431342] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.431517] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.431648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.431804] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9dcad9a8-6566-4b84-a310-12f7b6257995" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.552231] env[66834]: INFO networking_nsxv3.common.synchronization [req-4a0fda0e-9e23-4967-8ba2-13220cab4ddc req-6d9b2452-3f37-4881-9589-b1ed5bf68018 tempest-InstanceActionsV221TestJSON-163739217 tempest-InstanceActionsV221TestJSON-163739217-project-member] Enqueued Resource ID: 240d0ecb-120a-48a6-aeb4-265ef374eeb1 with Priority: HIGHEST for action security_group_members [ 609.553404] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 240d0ecb-120a-48a6-aeb4-265ef374eeb1 with Priority: HIGHEST for action security_group_members [ 609.554533] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-240d0ecb-120a-48a6-aeb4-265ef374eeb1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.554533] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.554533] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.555592] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.555592] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.555592] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.555592] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.555592] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.555592] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.555592] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('240d0ecb-120a-48a6-aeb4-265ef374eeb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.833970] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff44f246-d9d7-4e42-b819-68687cceb347 [ 609.835748] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.835748] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.835748] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.835748] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.835748] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.835748] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff44f246-d9d7-4e42-b819-68687cceb347 already deleted. [ 609.835748] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff44f246-d9d7-4e42-b819-68687cceb347" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.909864] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.925026] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-991 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.925026] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-991" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.925026] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-991" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.925026] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-991" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.925026] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.925026] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.925026] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.925026] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.925767] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.926099] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.926257] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 609.927206] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 609.927206] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 609.927206] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.927206] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 609.927452] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 609.946601] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 609.946761] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 609.946892] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 609.947077] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-991" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.947414] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-cf8d5815-a5ec-4a78-ac01-afe68b6ae2eb taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.947594] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-cf8d5815-a5ec-4a78-ac01-afe68b6ae2eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.947709] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-cf8d5815-a5ec-4a78-ac01-afe68b6ae2eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.948035] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-cf8d5815-a5ec-4a78-ac01-afe68b6ae2eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.948364] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf8d5815-a5ec-4a78-ac01-afe68b6ae2eb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.061141] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.061141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.061141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.061141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.061423] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.061800] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.061800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.061800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.061996] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.062301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.062301] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 240d0ecb-120a-48a6-aeb4-265ef374eeb1 already deleted. [ 610.062409] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.120680] env[66834]: INFO networking_nsxv3.common.synchronization [req-122ee4cc-bd58-43c7-b9c9-0bc6723db9ba req-9b59ee27-d673-448f-9c9a-0f7c2e5db24d tempest-ServerDiagnosticsTest-1632880676 tempest-ServerDiagnosticsTest-1632880676-project-member] Enqueued Resource ID: 5a725faa-03fa-4615-b825-f2c19527a60c with Priority: HIGHEST for action security_group_members [ 610.121357] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a725faa-03fa-4615-b825-f2c19527a60c with Priority: HIGHEST for action security_group_members [ 610.121763] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a725faa-03fa-4615-b825-f2c19527a60c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.121932] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.122182] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.122456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.122667] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.122838] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.122930] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.123176] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.123265] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.123355] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a725faa-03fa-4615-b825-f2c19527a60c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.153417] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 in Status: SUCCESS [ 610.153620] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 deletion is rescheduled due to dependency. [ 610.153742] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.413627] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.413826] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.413922] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.414253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.414364] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.414604] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 is going to be created. [ 610.439061] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.439201] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.439275] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.439523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.439685] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.450575] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 in Status: UNINITIALIZED for 2s [ 610.453185] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.453391] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.453474] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.453728] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.453868] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.454020] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port cf8d5815-a5ec-4a78-ac01-afe68b6ae2eb not found, creating... [ 610.454331] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.454410] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.454496] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.454799] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.455108] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.455524] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.455670] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.455782] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.455984] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.456124] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.456257] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: cf8d5815-a5ec-4a78-ac01-afe68b6ae2eb is going to be created. [ 610.476247] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.476451] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.476540] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.476787] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.476998] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.477343] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-cf8d5815-a5ec-4a78-ac01-afe68b6ae2eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.516612] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb6f8ce6-311d-4e8e-b179-b86a971739cb in Status: SUCCESS [ 610.516840] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.625696] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.625884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.625944] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.626190] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.626269] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.626463] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.626562] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.626624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.626768] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.626867] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.626923] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a725faa-03fa-4615-b825-f2c19527a60c is going to be updated. [ 610.654499] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.654656] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.654709] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.654914] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.655068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.666902] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a725faa-03fa-4615-b825-f2c19527a60c in Status: IN_PROGRESS for 2s [ 611.175209] env[66834]: INFO networking_nsxv3.common.synchronization [req-4a0fda0e-9e23-4967-8ba2-13220cab4ddc req-5bdf7eae-f761-470c-aaf7-5fe488d97a73 service nova] Enqueued Resource ID: 240d0ecb-120a-48a6-aeb4-265ef374eeb1 with Priority: HIGHEST for action security_group_rules [ 611.175209] env[66834]: INFO networking_nsxv3.common.synchronization [req-4a0fda0e-9e23-4967-8ba2-13220cab4ddc req-5bdf7eae-f761-470c-aaf7-5fe488d97a73 service nova] Enqueued Resource ID: 240d0ecb-120a-48a6-aeb4-265ef374eeb1 with Priority: HIGHEST for action security_group_members [ 611.175209] env[66834]: INFO networking_nsxv3.common.synchronization [req-4a0fda0e-9e23-4967-8ba2-13220cab4ddc req-5bdf7eae-f761-470c-aaf7-5fe488d97a73 service nova] Enqueued Resource ID: cf8d5815-a5ec-4a78-ac01-afe68b6ae2eb with Priority: HIGHEST for action port [ 611.175209] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 240d0ecb-120a-48a6-aeb4-265ef374eeb1 with Priority: HIGHEST for action security_group_rules [ 611.175209] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 240d0ecb-120a-48a6-aeb4-265ef374eeb1 with Priority: HIGHEST for action security_group_members [ 611.175209] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf8d5815-a5ec-4a78-ac01-afe68b6ae2eb with Priority: HIGHEST for action port [ 611.176052] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-240d0ecb-120a-48a6-aeb4-265ef374eeb1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.176759] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.177047] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.180086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.180086] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('240d0ecb-120a-48a6-aeb4-265ef374eeb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.180086] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-240d0ecb-120a-48a6-aeb4-265ef374eeb1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.180086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.180086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.180086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.180086] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.180086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.180086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.180086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.180086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.180086] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('240d0ecb-120a-48a6-aeb4-265ef374eeb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.182951] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf8d5815-a5ec-4a78-ac01-afe68b6ae2eb taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.182951] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf8d5815-a5ec-4a78-ac01-afe68b6ae2eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.182951] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf8d5815-a5ec-4a78-ac01-afe68b6ae2eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.182951] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf8d5815-a5ec-4a78-ac01-afe68b6ae2eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.182951] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf8d5815-a5ec-4a78-ac01-afe68b6ae2eb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.685125] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('240d0ecb-120a-48a6-aeb4-265ef374eeb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.686252] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-240d0ecb-120a-48a6-aeb4-265ef374eeb1 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.686459] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.687033] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf8d5815-a5ec-4a78-ac01-afe68b6ae2eb with status ACTIVE [ 611.687142] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.687296] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.687453] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.687982] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.688204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.689011] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.689011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.689011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.689011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.689011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.689474] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.689533] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.689575] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.689712] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.689783] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.689894] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf8d5815-a5ec-4a78-ac01-afe68b6ae2eb is going to be updated. [ 611.714404] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.714404] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.714404] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.715466] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.715466] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.715466] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf8d5815-a5ec-4a78-ac01-afe68b6ae2eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.187645] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('240d0ecb-120a-48a6-aeb4-265ef374eeb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.465536] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 in Status: SUCCESS [ 612.465536] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.465830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.466039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.466264] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.466353] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.466418] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.466576] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.466657] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.466740] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.466831] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.652523] env[66834]: INFO networking_nsxv3.common.synchronization [None req-0a3a7154-e689-4e75-9656-96c0a48667d1 None None] Enqueued Resource ID: 602efb65-2d2d-4689-8bfa-8e5d19904d54 with Priority: HIGHEST for action port [ 612.653687] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 602efb65-2d2d-4689-8bfa-8e5d19904d54 with Priority: HIGHEST for action port [ 612.654095] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-602efb65-2d2d-4689-8bfa-8e5d19904d54 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.654345] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-602efb65-2d2d-4689-8bfa-8e5d19904d54" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.654431] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-602efb65-2d2d-4689-8bfa-8e5d19904d54" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.654717] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-602efb65-2d2d-4689-8bfa-8e5d19904d54" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.654855] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('602efb65-2d2d-4689-8bfa-8e5d19904d54',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.678407] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a725faa-03fa-4615-b825-f2c19527a60c in Status: SUCCESS [ 612.678671] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a725faa-03fa-4615-b825-f2c19527a60c deletion is rescheduled due to dependency. [ 612.678829] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.693891] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.694068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.694175] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.694429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.694523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.694639] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 240d0ecb-120a-48a6-aeb4-265ef374eeb1 is going to be created. [ 612.721988] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.722747] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.722747] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.722747] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.722747] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.735135] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 240d0ecb-120a-48a6-aeb4-265ef374eeb1 in Status: UNINITIALIZED for 2s [ 612.971609] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.971714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.971714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.971928] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.972195] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.972195] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.972299] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.972413] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.972500] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.972581] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.972729] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.972810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.972871] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.973035] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.973158] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.973417] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.973417] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.973417] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.973536] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.973568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.973664] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.156799] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 602efb65-2d2d-4689-8bfa-8e5d19904d54 [ 613.158457] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.158457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.158457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.158457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.158457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.158457] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:602efb65-2d2d-4689-8bfa-8e5d19904d54 already deleted. [ 613.158457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-602efb65-2d2d-4689-8bfa-8e5d19904d54" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.478363] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4: rpc.has_security_group_logging(os_id): False [ 613.499899] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.500067] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.500140] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.500370] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.500487] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.500651] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.500725] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.500792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.500943] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.501047] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.501241] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.501333] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.501457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.501528] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.501612] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.501816] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.501915] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.501915] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.502940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.502940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.502940] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 is going to be created. [ 613.565455] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.565685] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.565811] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.566187] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.566327] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.587264] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 in Status: IN_PROGRESS for 2s [ 613.634149] env[66834]: INFO networking_nsxv3.common.synchronization [req-dfe4a03f-8b9b-4c0b-a449-7c2a59cc0d95 req-2b7418ab-0bf2-4907-89f9-6887f328e634 tempest-MigrationsAdminTest-1673437967 tempest-MigrationsAdminTest-1673437967-project-member] Enqueued Resource ID: f46326b4-7843-4c05-8eca-cb73edd99c30 with Priority: HIGHEST for action security_group_members [ 613.634401] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f46326b4-7843-4c05-8eca-cb73edd99c30 with Priority: HIGHEST for action security_group_members [ 613.634767] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-f46326b4-7843-4c05-8eca-cb73edd99c30 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.634904] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.635180] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.635633] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.635834] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.635941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.635988] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.636198] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.636260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.636400] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f46326b4-7843-4c05-8eca-cb73edd99c30',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.137654] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-582 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.138510] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.138510] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.138510] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.138788] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.138788] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.138878] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.139510] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.139510] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.139668] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.139790] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 614.140016] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 614.140016] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 614.140098] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.140721] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 614.140721] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 614.142664] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.142768] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.142844] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.142986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.143195] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.144024] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.144024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.144024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.144024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.144024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.144024] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f46326b4-7843-4c05-8eca-cb73edd99c30 already deleted. [ 614.144298] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.161547] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 614.161718] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 614.161816] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 614.161979] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.162311] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-0f831123-82b3-46d3-8685-c72681bdb4c2 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.162474] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-0f831123-82b3-46d3-8685-c72681bdb4c2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.162583] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-0f831123-82b3-46d3-8685-c72681bdb4c2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.162884] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-0f831123-82b3-46d3-8685-c72681bdb4c2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.163050] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f831123-82b3-46d3-8685-c72681bdb4c2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.257355] env[66834]: INFO networking_nsxv3.common.synchronization [None req-c79b46d6-68ae-45a8-a9e8-abf6473fec80 None None] Enqueued Resource ID: 94b30bef-8d25-4eb4-87d9-c9397d702a75 with Priority: HIGHEST for action port [ 614.257355] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94b30bef-8d25-4eb4-87d9-c9397d702a75 with Priority: HIGHEST for action port [ 614.257355] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-94b30bef-8d25-4eb4-87d9-c9397d702a75 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.257858] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94b30bef-8d25-4eb4-87d9-c9397d702a75" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.258145] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94b30bef-8d25-4eb4-87d9-c9397d702a75" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.258934] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94b30bef-8d25-4eb4-87d9-c9397d702a75" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.259139] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94b30bef-8d25-4eb4-87d9-c9397d702a75',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.418312] env[66834]: INFO networking_nsxv3.common.synchronization [None req-7d94ea48-038d-494a-baf5-7f5743d249b7 None None] Enqueued Resource ID: 0d1523b4-1bd6-4369-98d0-56f9ee080ccc with Priority: HIGHEST for action port [ 614.419024] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d1523b4-1bd6-4369-98d0-56f9ee080ccc with Priority: HIGHEST for action port [ 614.419024] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d1523b4-1bd6-4369-98d0-56f9ee080ccc taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.419151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d1523b4-1bd6-4369-98d0-56f9ee080ccc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.419202] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d1523b4-1bd6-4369-98d0-56f9ee080ccc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.419462] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d1523b4-1bd6-4369-98d0-56f9ee080ccc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.419547] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d1523b4-1bd6-4369-98d0-56f9ee080ccc',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.667951] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.667951] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.667951] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.667951] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.667951] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.667951] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 0f831123-82b3-46d3-8685-c72681bdb4c2 not found, creating... [ 614.668729] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.668729] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.668729] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.668729] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.669143] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.669143] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.669291] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.669352] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.669886] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.669886] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.669886] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 0f831123-82b3-46d3-8685-c72681bdb4c2 is going to be created. [ 614.677611] env[66834]: INFO networking_nsxv3.common.synchronization [req-79c523a9-6946-48ed-a2fd-569b56b8b3c0 req-459b7ce6-fa06-4cdd-b106-3df13d217188 tempest-ServerDiagnosticsNegativeTest-1078775155 tempest-ServerDiagnosticsNegativeTest-1078775155-project-member] Enqueued Resource ID: 8ef26513-917e-4754-b69d-1d511bcb585b with Priority: HIGHEST for action security_group_members [ 614.677611] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ef26513-917e-4754-b69d-1d511bcb585b with Priority: HIGHEST for action security_group_members [ 614.677898] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ef26513-917e-4754-b69d-1d511bcb585b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.678036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.678100] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.678272] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.678415] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.678502] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.678563] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.678705] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.678780] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.678878] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ef26513-917e-4754-b69d-1d511bcb585b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.696120] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.696334] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.696451] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.696709] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.696915] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.697139] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-0f831123-82b3-46d3-8685-c72681bdb4c2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.747743] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 240d0ecb-120a-48a6-aeb4-265ef374eeb1 in Status: SUCCESS [ 614.747743] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.747743] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.747743] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.747743] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.747743] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.747743] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.747743] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.747743] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.747743] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.747743] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('240d0ecb-120a-48a6-aeb4-265ef374eeb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.760724] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94b30bef-8d25-4eb4-87d9-c9397d702a75 [ 614.760935] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.761076] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.761146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.761335] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.761420] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.761508] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94b30bef-8d25-4eb4-87d9-c9397d702a75 already deleted. [ 614.761587] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94b30bef-8d25-4eb4-87d9-c9397d702a75" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.922649] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d1523b4-1bd6-4369-98d0-56f9ee080ccc [ 614.922863] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.923201] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.923201] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.923588] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.923588] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.923588] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d1523b4-1bd6-4369-98d0-56f9ee080ccc already deleted. [ 614.923588] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d1523b4-1bd6-4369-98d0-56f9ee080ccc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.924528] env[66834]: INFO networking_nsxv3.common.synchronization [req-a25c9b0f-18af-4d63-8f89-a429ad5b9171 req-bab3f88c-24c9-4de3-933b-e258912bd2a4 tempest-TenantUsagesTestJSON-996040502 tempest-TenantUsagesTestJSON-996040502-project-member] Enqueued Resource ID: d9115622-9b53-4106-895d-803c18358d29 with Priority: HIGHEST for action security_group_members [ 614.925141] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9115622-9b53-4106-895d-803c18358d29 with Priority: HIGHEST for action security_group_members [ 614.925451] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9115622-9b53-4106-895d-803c18358d29 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.925894] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.925894] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.925894] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.926139] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.926139] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.926139] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.926295] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.926356] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.926451] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9115622-9b53-4106-895d-803c18358d29',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.181539] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.181721] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.181803] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.182711] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.183069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.183352] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.183501] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.183582] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.183827] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.183941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.184070] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ef26513-917e-4754-b69d-1d511bcb585b is going to be updated. [ 615.215425] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.215425] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.215425] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.215425] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.215425] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.228022] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ef26513-917e-4754-b69d-1d511bcb585b in Status: IN_PROGRESS for 2s [ 615.250316] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-240d0ecb-120a-48a6-aeb4-265ef374eeb1 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.250540] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.250655] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.250879] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.251119] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.251249] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.251318] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.251559] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.251652] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.251766] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.251936] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-240d0ecb-120a-48a6-aeb4-265ef374eeb1 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.253196] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.253196] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.253372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.253479] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.253562] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.253562] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.253701] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.253780] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.254128] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.258023] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('240d0ecb-120a-48a6-aeb4-265ef374eeb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.428597] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.428867] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.429599] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.429845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.429951] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.430236] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.430381] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.430476] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.430687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.430771] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.431123] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9115622-9b53-4106-895d-803c18358d29 is going to be updated. [ 615.460620] env[66834]: INFO networking_nsxv3.common.synchronization [req-dfe4a03f-8b9b-4c0b-a449-7c2a59cc0d95 req-18ee187a-20c4-4976-81b2-611544076897 service nova] Enqueued Resource ID: f46326b4-7843-4c05-8eca-cb73edd99c30 with Priority: HIGHEST for action security_group_rules [ 615.462241] env[66834]: INFO networking_nsxv3.common.synchronization [req-dfe4a03f-8b9b-4c0b-a449-7c2a59cc0d95 req-18ee187a-20c4-4976-81b2-611544076897 service nova] Enqueued Resource ID: f46326b4-7843-4c05-8eca-cb73edd99c30 with Priority: HIGHEST for action security_group_members [ 615.462786] env[66834]: INFO networking_nsxv3.common.synchronization [req-dfe4a03f-8b9b-4c0b-a449-7c2a59cc0d95 req-18ee187a-20c4-4976-81b2-611544076897 service nova] Enqueued Resource ID: 0f831123-82b3-46d3-8685-c72681bdb4c2 with Priority: HIGHEST for action port [ 615.463644] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f46326b4-7843-4c05-8eca-cb73edd99c30 with Priority: HIGHEST for action security_group_rules [ 615.466947] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f46326b4-7843-4c05-8eca-cb73edd99c30 with Priority: HIGHEST for action security_group_members [ 615.467261] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f831123-82b3-46d3-8685-c72681bdb4c2 with Priority: HIGHEST for action port [ 615.468544] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.468726] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.468797] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.469167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.469358] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.470963] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f46326b4-7843-4c05-8eca-cb73edd99c30 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.470963] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.470963] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.471226] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.472025] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f46326b4-7843-4c05-8eca-cb73edd99c30',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.473504] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-f46326b4-7843-4c05-8eca-cb73edd99c30 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.473658] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.473838] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.473905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.474030] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.474161] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.474205] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.474328] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.474409] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.474508] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f46326b4-7843-4c05-8eca-cb73edd99c30',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.475467] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f831123-82b3-46d3-8685-c72681bdb4c2 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.475590] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f831123-82b3-46d3-8685-c72681bdb4c2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.475633] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f831123-82b3-46d3-8685-c72681bdb4c2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.475790] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f831123-82b3-46d3-8685-c72681bdb4c2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.475865] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f831123-82b3-46d3-8685-c72681bdb4c2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.487908] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9115622-9b53-4106-895d-803c18358d29 in Status: IN_PROGRESS for 2s [ 615.598992] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 in Status: SUCCESS [ 615.599261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.757954] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 240d0ecb-120a-48a6-aeb4-265ef374eeb1: rpc.has_security_group_logging(os_id): False [ 615.778894] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.779079] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.779175] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.779466] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.780108] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.780108] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.780108] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.780108] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.780295] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.780295] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.780463] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.780560] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.780622] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.780785] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.780862] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.782417] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.782417] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.782417] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.782417] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.782417] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.782417] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 240d0ecb-120a-48a6-aeb4-265ef374eeb1 is going to be created. [ 615.869436] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.870095] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.870347] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.870640] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.870922] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.887932] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 240d0ecb-120a-48a6-aeb4-265ef374eeb1 in Status: IN_PROGRESS for 2s [ 615.890948] env[66834]: INFO networking_nsxv3.common.synchronization [req-1b543b3c-60c5-4804-aeef-d075da852584 req-99defe3a-a177-4b39-8cd7-9f585fa6c49f tempest-ImagesTestJSON-910661197 tempest-ImagesTestJSON-910661197-project-member] Enqueued Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 615.891573] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 615.891886] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.892035] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.892107] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.893372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.893778] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.894104] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.894304] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.894993] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.895275] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.895504] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.979125] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f46326b4-7843-4c05-8eca-cb73edd99c30',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.980449] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-f46326b4-7843-4c05-8eca-cb73edd99c30 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.980599] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.980795] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f831123-82b3-46d3-8685-c72681bdb4c2 with status ACTIVE [ 615.980971] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.981158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.981280] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.981668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.981842] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.986757] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.987068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.987144] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.988370] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.990810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.990810] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.990810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.990810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.990810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.990810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.990810] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f831123-82b3-46d3-8685-c72681bdb4c2 is going to be updated. [ 616.020707] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.021078] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.021078] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.021402] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.021402] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.022243] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f831123-82b3-46d3-8685-c72681bdb4c2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.308249] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-793 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.308505] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-793" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.308649] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-793" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.309252] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-793" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.309444] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.309674] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.309879] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.310237] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.310385] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.310607] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.310728] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 616.310896] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 616.311142] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 616.311280] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.311402] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 616.311580] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 616.338901] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 616.341939] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 616.341939] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 616.341939] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-793" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.341939] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-abaf63e4-9584-47fa-958c-501198b21e32 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.341939] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-abaf63e4-9584-47fa-958c-501198b21e32" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.341939] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-abaf63e4-9584-47fa-958c-501198b21e32" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.341939] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-abaf63e4-9584-47fa-958c-501198b21e32" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.341939] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abaf63e4-9584-47fa-958c-501198b21e32',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.399298] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.399298] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.399298] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.399568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.399568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.399699] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.399755] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.399787] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.400063] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.400063] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.400245] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 already deleted. [ 616.400297] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.493119] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f46326b4-7843-4c05-8eca-cb73edd99c30',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.648074] env[66834]: INFO networking_nsxv3.common.synchronization [None req-8ee247f8-ca9e-4ce2-969a-82318569db10 None None] Enqueued Resource ID: dbc30395-df38-460b-aae6-3c6629b8f963 with Priority: HIGHEST for action port [ 616.648511] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbc30395-df38-460b-aae6-3c6629b8f963 with Priority: HIGHEST for action port [ 616.648816] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbc30395-df38-460b-aae6-3c6629b8f963 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.648974] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbc30395-df38-460b-aae6-3c6629b8f963" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.649041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbc30395-df38-460b-aae6-3c6629b8f963" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.649257] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbc30395-df38-460b-aae6-3c6629b8f963" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.649336] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbc30395-df38-460b-aae6-3c6629b8f963',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.845085] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.845483] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.845483] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.845782] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.845927] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.846095] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port abaf63e4-9584-47fa-958c-501198b21e32 not found, creating... [ 616.846343] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.846509] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.846621] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.846859] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.846987] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.847270] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.847492] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.847596] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.847821] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.847948] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.848112] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: abaf63e4-9584-47fa-958c-501198b21e32 is going to be created. [ 616.872469] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.873048] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.873048] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.873611] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.873611] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.873906] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-abaf63e4-9584-47fa-958c-501198b21e32" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.995691] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.995938] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.996030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.996266] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.996374] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.996511] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f46326b4-7843-4c05-8eca-cb73edd99c30 is going to be created. [ 617.035552] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.035732] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.035811] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.035979] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.036161] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.048074] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f46326b4-7843-4c05-8eca-cb73edd99c30 in Status: UNINITIALIZED for 2s [ 617.152216] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dbc30395-df38-460b-aae6-3c6629b8f963 [ 617.152728] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.153670] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.153670] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.153670] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.153670] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.153670] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dbc30395-df38-460b-aae6-3c6629b8f963 already deleted. [ 617.153670] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbc30395-df38-460b-aae6-3c6629b8f963" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.236162] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ef26513-917e-4754-b69d-1d511bcb585b in Status: SUCCESS [ 617.236427] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ef26513-917e-4754-b69d-1d511bcb585b deletion is rescheduled due to dependency. [ 617.236549] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.498107] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9115622-9b53-4106-895d-803c18358d29 in Status: SUCCESS [ 617.498284] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9115622-9b53-4106-895d-803c18358d29 deletion is rescheduled due to dependency. [ 617.498890] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.550922] env[66834]: INFO networking_nsxv3.common.synchronization [req-1b543b3c-60c5-4804-aeef-d075da852584 req-a6138a4e-cc0e-4d08-9238-b7067e677ddf service nova] Enqueued Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_rules [ 617.551116] env[66834]: INFO networking_nsxv3.common.synchronization [req-1b543b3c-60c5-4804-aeef-d075da852584 req-a6138a4e-cc0e-4d08-9238-b7067e677ddf service nova] Enqueued Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 617.551252] env[66834]: INFO networking_nsxv3.common.synchronization [req-1b543b3c-60c5-4804-aeef-d075da852584 req-a6138a4e-cc0e-4d08-9238-b7067e677ddf service nova] Enqueued Resource ID: abaf63e4-9584-47fa-958c-501198b21e32 with Priority: HIGHEST for action port [ 617.551746] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_rules [ 617.551882] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 617.551978] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abaf63e4-9584-47fa-958c-501198b21e32 with Priority: HIGHEST for action port [ 617.552256] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.552385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.552453] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.552712] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.552964] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.554115] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.555051] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.555051] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.555051] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.555051] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.555051] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.555051] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.555051] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.555366] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.555366] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.558308] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-abaf63e4-9584-47fa-958c-501198b21e32 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.558308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abaf63e4-9584-47fa-958c-501198b21e32" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.558308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abaf63e4-9584-47fa-958c-501198b21e32" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.558308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abaf63e4-9584-47fa-958c-501198b21e32" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.558308] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abaf63e4-9584-47fa-958c-501198b21e32',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.902241] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 240d0ecb-120a-48a6-aeb4-265ef374eeb1 in Status: SUCCESS [ 617.902480] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.978991] env[66834]: INFO networking_nsxv3.common.synchronization [req-d89d6571-31c6-4dd6-99c6-274f69e45ebf req-398d5daa-5c5a-4f1c-8d97-d83184a93386 tempest-FloatingIPsAssociationTestJSON-737304436 tempest-FloatingIPsAssociationTestJSON-737304436-project-member] Enqueued Resource ID: 01965726-b599-4a24-a0ef-beaaba998cf3 with Priority: HIGHEST for action security_group_members [ 617.979128] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01965726-b599-4a24-a0ef-beaaba998cf3 with Priority: HIGHEST for action security_group_members [ 617.979349] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-01965726-b599-4a24-a0ef-beaaba998cf3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.979472] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.979529] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.980147] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.980147] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.980372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.980372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.980592] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.980674] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.980727] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01965726-b599-4a24-a0ef-beaaba998cf3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.059564] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.059797] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.060035] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.063228] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port abaf63e4-9584-47fa-958c-501198b21e32 with status ACTIVE [ 618.063228] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.063228] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.063228] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.063419] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.063577] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.063782] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.063935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.064043] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.064260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.064905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.065093] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.065301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.065406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.066025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.066025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.066025] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: abaf63e4-9584-47fa-958c-501198b21e32 is going to be updated. [ 618.093670] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.093670] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.093906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.094328] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.094328] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.094471] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abaf63e4-9584-47fa-958c-501198b21e32" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.423020] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-153 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.423020] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-153" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.423020] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-153" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.423020] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-153" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.423020] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.423020] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.423020] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.423020] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.423020] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.423020] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.423892] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 618.424248] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 618.424578] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 618.424999] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.427294] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 618.427294] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 618.446078] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 618.446078] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 618.446306] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 618.446350] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-153" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.446941] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-94b30e19-06ad-4e89-924f-7319709f27ec taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.447639] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-94b30e19-06ad-4e89-924f-7319709f27ec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.447639] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-94b30e19-06ad-4e89-924f-7319709f27ec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.447883] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-94b30e19-06ad-4e89-924f-7319709f27ec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.448144] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94b30e19-06ad-4e89-924f-7319709f27ec',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.484118] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.484290] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.484434] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.484619] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.484699] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.484934] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.485083] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.485143] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.485298] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.485380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.485457] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01965726-b599-4a24-a0ef-beaaba998cf3 already deleted. [ 618.485541] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.563349] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.951285] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.951619] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.952194] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.952576] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.952864] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.953185] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 94b30e19-06ad-4e89-924f-7319709f27ec not found, creating... [ 618.953702] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.953964] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.954118] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.954344] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.954516] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.954775] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.954933] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.955055] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.955321] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.955450] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.955561] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 94b30e19-06ad-4e89-924f-7319709f27ec is going to be created. [ 618.979239] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.979638] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.979765] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.980169] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.980433] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.980718] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-94b30e19-06ad-4e89-924f-7319709f27ec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.066482] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.066731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.066731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.066944] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.067071] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.067178] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 is going to be created. [ 619.073173] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f46326b4-7843-4c05-8eca-cb73edd99c30 in Status: SUCCESS [ 619.073306] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.073566] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.073786] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.074029] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.074153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.074228] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.074522] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.074522] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.074679] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.074679] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f46326b4-7843-4c05-8eca-cb73edd99c30',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.122421] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.122669] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.122669] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.123449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.123449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.139856] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: UNINITIALIZED for 2s [ 619.558995] env[66834]: INFO networking_nsxv3.common.synchronization [req-8f39c333-291a-4ee6-904e-11ea363b8a22 req-52aae674-7454-43b6-8fe1-e54fb01e6334 tempest-ServerActionsTestJSON-2105447671 tempest-ServerActionsTestJSON-2105447671-project-member] Enqueued Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_members [ 619.558995] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_members [ 619.559438] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b33fa48-b9ca-426c-b890-67d4639035e2 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.559519] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.559573] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.559823] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.560053] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.560140] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.561595] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.561595] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.561595] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.561595] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.576796] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-f46326b4-7843-4c05-8eca-cb73edd99c30 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.576932] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.577010] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.577229] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.577453] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.577551] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.577594] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.577709] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.577789] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.577869] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.578068] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-f46326b4-7843-4c05-8eca-cb73edd99c30 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.578135] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.578173] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.578696] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.578696] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.578696] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.578696] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.578896] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.579099] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.579099] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.579929] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f46326b4-7843-4c05-8eca-cb73edd99c30',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.712188] env[66834]: INFO networking_nsxv3.common.synchronization [req-d89d6571-31c6-4dd6-99c6-274f69e45ebf req-e64241a4-7fd3-4617-b758-50182d815dc6 service nova] Enqueued Resource ID: 01965726-b599-4a24-a0ef-beaaba998cf3 with Priority: HIGHEST for action security_group_rules [ 619.712358] env[66834]: INFO networking_nsxv3.common.synchronization [req-d89d6571-31c6-4dd6-99c6-274f69e45ebf req-e64241a4-7fd3-4617-b758-50182d815dc6 service nova] Enqueued Resource ID: 01965726-b599-4a24-a0ef-beaaba998cf3 with Priority: HIGHEST for action security_group_members [ 619.712489] env[66834]: INFO networking_nsxv3.common.synchronization [req-d89d6571-31c6-4dd6-99c6-274f69e45ebf req-e64241a4-7fd3-4617-b758-50182d815dc6 service nova] Enqueued Resource ID: 94b30e19-06ad-4e89-924f-7319709f27ec with Priority: HIGHEST for action port [ 619.713011] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01965726-b599-4a24-a0ef-beaaba998cf3 with Priority: HIGHEST for action security_group_rules [ 619.713154] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01965726-b599-4a24-a0ef-beaaba998cf3 with Priority: HIGHEST for action security_group_members [ 619.713245] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94b30e19-06ad-4e89-924f-7319709f27ec with Priority: HIGHEST for action port [ 619.718027] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01965726-b599-4a24-a0ef-beaaba998cf3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.718027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.718027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.718027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.718027] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01965726-b599-4a24-a0ef-beaaba998cf3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.718027] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-01965726-b599-4a24-a0ef-beaaba998cf3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.718027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.718027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.718027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.718027] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.718027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.718027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.718027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.718027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.718027] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01965726-b599-4a24-a0ef-beaaba998cf3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.718027] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-94b30e19-06ad-4e89-924f-7319709f27ec taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.719299] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94b30e19-06ad-4e89-924f-7319709f27ec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.719299] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94b30e19-06ad-4e89-924f-7319709f27ec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.719597] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94b30e19-06ad-4e89-924f-7319709f27ec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.719597] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94b30e19-06ad-4e89-924f-7319709f27ec',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.066187] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.066187] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.066187] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.066187] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.066187] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.066187] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.066187] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.066187] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.066187] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.066785] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.066785] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 already deleted. [ 620.066848] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.083546] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f46326b4-7843-4c05-8eca-cb73edd99c30: rpc.has_security_group_logging(os_id): False [ 620.103815] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.103982] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.104059] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.105429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.105429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.105429] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.105429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.105429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.105429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.105429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.105429] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.105429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.105429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.105954] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.105954] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.105954] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.105954] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.106431] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.106721] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.106787] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.106973] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f46326b4-7843-4c05-8eca-cb73edd99c30 is going to be created. [ 620.178078] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.178259] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.178528] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.178908] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.179240] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.193090] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f46326b4-7843-4c05-8eca-cb73edd99c30 in Status: IN_PROGRESS for 2s [ 620.207434] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-591 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.207727] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-591" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.207886] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-591" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.208368] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-591" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.208585] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.208760] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.208871] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.209147] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.209307] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.209526] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.209640] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 620.209745] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 620.209886] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 620.210047] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.210119] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 620.210237] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 620.224673] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-01965726-b599-4a24-a0ef-beaaba998cf3 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.224673] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.224673] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01965726-b599-4a24-a0ef-beaaba998cf3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.226038] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94b30e19-06ad-4e89-924f-7319709f27ec with status ACTIVE [ 620.226038] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.226038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.226336] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.229775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.229775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.229775] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.229775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.229775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.229775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.229775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.230349] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.230349] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.230435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.230723] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.231035] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.231561] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94b30e19-06ad-4e89-924f-7319709f27ec is going to be updated. [ 620.234161] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 620.235744] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 620.235744] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 620.235744] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-591" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.236037] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-20aa73c8-268c-46cc-8ef3-7ef9b0d965a7 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.236146] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-20aa73c8-268c-46cc-8ef3-7ef9b0d965a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.236308] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-20aa73c8-268c-46cc-8ef3-7ef9b0d965a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.236684] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-20aa73c8-268c-46cc-8ef3-7ef9b0d965a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.236887] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20aa73c8-268c-46cc-8ef3-7ef9b0d965a7',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.252686] env[66834]: INFO networking_nsxv3.common.synchronization [None req-8d89c12c-5eae-4e80-bc32-7a6ee67006b2 tempest-AttachInterfacesUnderV243Test-828580212 tempest-AttachInterfacesUnderV243Test-828580212-project-member] Enqueued Resource ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 with Priority: HIGHEST for action security_group_rules [ 620.254043] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 with Priority: HIGHEST for action security_group_rules [ 620.254633] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.254633] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.254633] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.255085] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.255085] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9117e7f6-fbaa-44a8-bc92-e3fb9acd2228',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.264220] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.264584] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.264703] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.264957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.265197] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.265518] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94b30e19-06ad-4e89-924f-7319709f27ec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.550830] env[66834]: INFO networking_nsxv3.common.synchronization [None req-d43704e3-5497-43d5-9b61-a1e24db73c15 tempest-AttachInterfacesUnderV243Test-828580212 tempest-AttachInterfacesUnderV243Test-828580212-project-member] Enqueued Resource ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 with Priority: HIGHEST for action security_group_rules [ 620.550830] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 with Priority: HIGHEST for action security_group_rules [ 620.550830] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.550830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.739955] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01965726-b599-4a24-a0ef-beaaba998cf3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.740467] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.740467] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.740791] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.740845] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.740969] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.741125] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 20aa73c8-268c-46cc-8ef3-7ef9b0d965a7 not found, creating... [ 620.741372] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.741676] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.741784] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.742433] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.746862] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.746862] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.746862] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.746862] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.746862] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.746862] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.746862] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 20aa73c8-268c-46cc-8ef3-7ef9b0d965a7 is going to be created. [ 620.777450] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.777695] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.777695] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.777870] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.777981] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.778500] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 already deleted. [ 620.778611] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.778801] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.779021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.779105] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9117e7f6-fbaa-44a8-bc92-e3fb9acd2228',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.782385] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.782647] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.782805] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.783051] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.783304] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.783699] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-20aa73c8-268c-46cc-8ef3-7ef9b0d965a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.151229] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: SUCCESS [ 621.151596] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.151596] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.151682] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.152094] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.152094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.152094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.152280] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.152280] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.153440] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.153440] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.247978] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.248469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.248469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.248469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.248729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.248729] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01965726-b599-4a24-a0ef-beaaba998cf3 is going to be created. [ 621.279438] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.279695] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.279787] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.280120] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.280436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.303331] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01965726-b599-4a24-a0ef-beaaba998cf3 in Status: UNINITIALIZED for 2s [ 621.319565] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.319647] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.319731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.319955] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.320053] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.320151] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 already deleted. [ 621.320231] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.555234] env[66834]: INFO networking_nsxv3.common.synchronization [req-8f39c333-291a-4ee6-904e-11ea363b8a22 req-63a40432-6096-463f-b356-157833b668a4 service nova] Enqueued Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_rules [ 621.556422] env[66834]: INFO networking_nsxv3.common.synchronization [req-8f39c333-291a-4ee6-904e-11ea363b8a22 req-63a40432-6096-463f-b356-157833b668a4 service nova] Enqueued Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_members [ 621.556422] env[66834]: INFO networking_nsxv3.common.synchronization [req-8f39c333-291a-4ee6-904e-11ea363b8a22 req-63a40432-6096-463f-b356-157833b668a4 service nova] Enqueued Resource ID: 20aa73c8-268c-46cc-8ef3-7ef9b0d965a7 with Priority: HIGHEST for action port [ 621.560285] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_rules [ 621.560285] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_members [ 621.560285] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20aa73c8-268c-46cc-8ef3-7ef9b0d965a7 with Priority: HIGHEST for action port [ 621.560285] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b33fa48-b9ca-426c-b890-67d4639035e2 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.560285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.560285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.560285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.560285] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.560285] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b33fa48-b9ca-426c-b890-67d4639035e2 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.560285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.560285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.560285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.560285] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.560285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.562192] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.562192] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.562192] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.562192] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.567141] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-20aa73c8-268c-46cc-8ef3-7ef9b0d965a7 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.567141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20aa73c8-268c-46cc-8ef3-7ef9b0d965a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.567141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20aa73c8-268c-46cc-8ef3-7ef9b0d965a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.567141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20aa73c8-268c-46cc-8ef3-7ef9b0d965a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.567141] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20aa73c8-268c-46cc-8ef3-7ef9b0d965a7',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.654852] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.658021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.658021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.658021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.658021] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.658021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.658021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.658021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.658021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.658021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.658021] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.658021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.658021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.658021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.658021] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.658021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.658021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.658021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.658021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.659089] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.659089] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.912517] env[66834]: INFO networking_nsxv3.common.synchronization [req-1a5edf01-2ea9-465b-8b81-ea5d5d34ea8c req-585da864-939e-45ab-9338-e068089cbdd8 tempest-VolumesAssistedSnapshotsTest-105506614 tempest-VolumesAssistedSnapshotsTest-105506614-project-member] Enqueued Resource ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 with Priority: HIGHEST for action security_group_members [ 621.912689] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 with Priority: HIGHEST for action security_group_members [ 621.913012] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-386f2bfa-81a7-40ba-a9a8-a207890c2528 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.913336] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.913459] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.913679] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.913835] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.913934] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.913987] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.914187] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.914272] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.914453] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('386f2bfa-81a7-40ba-a9a8-a207890c2528',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.070540] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.070823] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b33fa48-b9ca-426c-b890-67d4639035e2 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.070965] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.071112] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 20aa73c8-268c-46cc-8ef3-7ef9b0d965a7 with status ACTIVE [ 622.071271] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.071421] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.071486] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.071738] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.071861] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.072000] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.072112] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.072166] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.072381] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.072465] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.072812] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.072812] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.072812] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.072966] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.073105] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.077406] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 20aa73c8-268c-46cc-8ef3-7ef9b0d965a7 is going to be updated. [ 622.101574] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.102204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.102204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.102886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.102886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.103132] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20aa73c8-268c-46cc-8ef3-7ef9b0d965a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.164388] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 599d582a-c0d7-4df7-a1fe-3e63412d8939: rpc.has_security_group_logging(os_id): False [ 622.211122] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.211122] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.211122] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.211122] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.211122] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.211122] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.211122] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.211122] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.211122] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.211122] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.211487] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.211487] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.211487] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.211582] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.211846] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.211846] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.211981] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.211981] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.212540] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.212540] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.212540] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 is going to be created. [ 622.235786] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f46326b4-7843-4c05-8eca-cb73edd99c30 in Status: SUCCESS [ 622.238026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.299590] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.299590] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.299590] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.299803] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.300031] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.312176] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-82 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.312411] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-82" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.312572] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-82" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.312922] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-82" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.313229] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.313389] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.313500] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.313719] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.313857] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.314072] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 622.314183] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 622.314288] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 622.314389] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 622.314509] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 622.314587] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 622.314713] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 622.336419] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: IN_PROGRESS for 2s [ 622.338823] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 622.338971] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 622.339117] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 622.339288] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-82" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.339589] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-14442fa8-7897-4623-8a51-99d17ca646e8 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.339823] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-14442fa8-7897-4623-8a51-99d17ca646e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.339944] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-14442fa8-7897-4623-8a51-99d17ca646e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.340297] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-14442fa8-7897-4623-8a51-99d17ca646e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.340731] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14442fa8-7897-4623-8a51-99d17ca646e8',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.417413] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.417413] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.417710] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.417755] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.418097] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.418097] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.418264] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.418264] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.418533] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.418533] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.418726] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 already deleted. [ 622.418726] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.580651] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.842669] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.842958] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.843111] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.843973] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.844071] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.844334] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 14442fa8-7897-4623-8a51-99d17ca646e8 not found, creating... [ 622.844664] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.844965] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.845037] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.845369] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.845530] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.845937] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.846169] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.846225] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.846464] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.846565] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.846697] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 14442fa8-7897-4623-8a51-99d17ca646e8 is going to be created. [ 622.875727] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.875727] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.875727] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.875969] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.876233] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.876454] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-14442fa8-7897-4623-8a51-99d17ca646e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.083305] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.083515] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.083593] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.083780] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.083899] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.083996] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 is going to be created. [ 623.112792] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.112988] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.113106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.113321] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.113514] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.130418] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 in Status: UNINITIALIZED for 2s [ 623.314417] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01965726-b599-4a24-a0ef-beaaba998cf3 in Status: SUCCESS [ 623.314684] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.314800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.315027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.315228] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.315352] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.315403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.315562] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.315644] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.315729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.315820] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01965726-b599-4a24-a0ef-beaaba998cf3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.612037] env[66834]: INFO networking_nsxv3.common.synchronization [req-1a5edf01-2ea9-465b-8b81-ea5d5d34ea8c req-1d66df11-d382-43d6-8aaf-6c22ed71e99b service nova] Enqueued Resource ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 with Priority: HIGHEST for action security_group_rules [ 623.612278] env[66834]: INFO networking_nsxv3.common.synchronization [req-1a5edf01-2ea9-465b-8b81-ea5d5d34ea8c req-1d66df11-d382-43d6-8aaf-6c22ed71e99b service nova] Enqueued Resource ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 with Priority: HIGHEST for action security_group_members [ 623.612278] env[66834]: INFO networking_nsxv3.common.synchronization [req-1a5edf01-2ea9-465b-8b81-ea5d5d34ea8c req-1d66df11-d382-43d6-8aaf-6c22ed71e99b service nova] Enqueued Resource ID: 14442fa8-7897-4623-8a51-99d17ca646e8 with Priority: HIGHEST for action port [ 623.612931] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 with Priority: HIGHEST for action security_group_rules [ 623.615352] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 with Priority: HIGHEST for action security_group_members [ 623.615564] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14442fa8-7897-4623-8a51-99d17ca646e8 with Priority: HIGHEST for action port [ 623.615912] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-386f2bfa-81a7-40ba-a9a8-a207890c2528 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.616059] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.616139] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.616337] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.616417] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('386f2bfa-81a7-40ba-a9a8-a207890c2528',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.618687] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-386f2bfa-81a7-40ba-a9a8-a207890c2528 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.618687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.618687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.618687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.618687] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.618687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.618687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.618687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.619280] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.619280] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('386f2bfa-81a7-40ba-a9a8-a207890c2528',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.621509] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-14442fa8-7897-4623-8a51-99d17ca646e8 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.622214] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14442fa8-7897-4623-8a51-99d17ca646e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.622315] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14442fa8-7897-4623-8a51-99d17ca646e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.622532] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14442fa8-7897-4623-8a51-99d17ca646e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.622667] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14442fa8-7897-4623-8a51-99d17ca646e8',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.818024] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-01965726-b599-4a24-a0ef-beaaba998cf3 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.818286] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.818380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.818688] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.818954] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.819385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.819385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.819563] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.819602] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.820125] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.820125] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-01965726-b599-4a24-a0ef-beaaba998cf3 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.820125] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.820377] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.820672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.820672] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.821649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.821649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.821649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.821649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.821649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.821649] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01965726-b599-4a24-a0ef-beaaba998cf3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.126997] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('386f2bfa-81a7-40ba-a9a8-a207890c2528',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.132075] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-386f2bfa-81a7-40ba-a9a8-a207890c2528 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.132075] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.132075] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14442fa8-7897-4623-8a51-99d17ca646e8 with status ACTIVE [ 624.132075] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.132075] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.132075] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.132075] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.132075] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.132075] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.132075] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.132075] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.132075] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.132075] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.132075] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.132897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.132897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.132897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.132897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.132897] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14442fa8-7897-4623-8a51-99d17ca646e8 is going to be updated. [ 624.156109] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.156109] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.156515] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.156515] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.156515] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.156690] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14442fa8-7897-4623-8a51-99d17ca646e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.324009] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01965726-b599-4a24-a0ef-beaaba998cf3: rpc.has_security_group_logging(os_id): False [ 624.343185] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.343410] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.343486] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.343746] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.343860] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.344121] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.344250] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.344306] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.344945] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.344945] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.344945] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.344945] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.344945] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.345190] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.345190] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.345449] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.345584] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.345649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.345797] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.345873] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.345959] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01965726-b599-4a24-a0ef-beaaba998cf3 is going to be created. [ 624.362219] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: SUCCESS [ 624.362219] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.410114] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.410279] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.411362] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.411362] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.411362] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.424130] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01965726-b599-4a24-a0ef-beaaba998cf3 in Status: IN_PROGRESS for 2s [ 624.634840] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('386f2bfa-81a7-40ba-a9a8-a207890c2528',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.124793] env[66834]: INFO networking_nsxv3.common.synchronization [req-af534e5b-765b-4579-a9f5-639b883dbbd2 req-f4ca8403-3bc0-4e90-8ec0-7180a74b5ed7 tempest-ImagesNegativeTestJSON-1790257005 tempest-ImagesNegativeTestJSON-1790257005-project-member] Enqueued Resource ID: cb6f8ce6-311d-4e8e-b179-b86a971739cb with Priority: HIGHEST for action security_group_members [ 625.124793] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb6f8ce6-311d-4e8e-b179-b86a971739cb with Priority: HIGHEST for action security_group_members [ 625.124793] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb6f8ce6-311d-4e8e-b179-b86a971739cb taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.125098] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.125098] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.125376] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.125581] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.125683] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.125743] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.125908] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.125993] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.126495] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb6f8ce6-311d-4e8e-b179-b86a971739cb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.137252] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.137638] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.137638] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.137916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.138059] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.139846] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 is going to be created. [ 625.145961] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 in Status: SUCCESS [ 625.145961] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.145961] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.145961] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.146185] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.146185] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.146297] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.149581] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.149581] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.149581] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.149581] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.166402] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.166644] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.166733] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.167058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.167274] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.180328] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 in Status: UNINITIALIZED for 2s [ 625.630256] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.631536] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.631536] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.631536] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.631536] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.631835] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.631835] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.631835] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.632144] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.634277] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.636202] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb6f8ce6-311d-4e8e-b179-b86a971739cb is going to be updated. [ 625.650628] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.701379] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.702394] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.702626] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.704349] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.704349] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.714581] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb6f8ce6-311d-4e8e-b179-b86a971739cb in Status: IN_PROGRESS for 2s [ 626.152816] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b33fa48-b9ca-426c-b890-67d4639035e2: rpc.has_security_group_logging(os_id): False [ 626.176031] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.176432] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.176524] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.177176] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.177282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.177605] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.177725] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.177781] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.178068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.178068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.178199] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 is going to be created. [ 626.264483] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.265305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.265696] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.266912] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.266912] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.279606] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 in Status: IN_PROGRESS for 2s [ 626.437856] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01965726-b599-4a24-a0ef-beaaba998cf3 in Status: SUCCESS [ 626.438087] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.736367] env[66834]: INFO networking_nsxv3.common.synchronization [None req-3b7fcfbc-85aa-4856-aba8-5cbff4b2e646 None None] Enqueued Resource ID: 30d1cd1e-09a2-449c-b797-27d65483b75d with Priority: HIGHEST for action port [ 626.738668] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d1cd1e-09a2-449c-b797-27d65483b75d with Priority: HIGHEST for action port [ 626.738668] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-30d1cd1e-09a2-449c-b797-27d65483b75d taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.738668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30d1cd1e-09a2-449c-b797-27d65483b75d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.738668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30d1cd1e-09a2-449c-b797-27d65483b75d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.738668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30d1cd1e-09a2-449c-b797-27d65483b75d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.738668] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30d1cd1e-09a2-449c-b797-27d65483b75d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.194523] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 in Status: SUCCESS [ 627.195492] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.195666] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.196093] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.196191] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.196280] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.196280] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.196464] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.196528] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.197462] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.197462] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('386f2bfa-81a7-40ba-a9a8-a207890c2528',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.243071] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30d1cd1e-09a2-449c-b797-27d65483b75d [ 627.243071] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.243071] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.243071] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.243071] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.243071] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.243071] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30d1cd1e-09a2-449c-b797-27d65483b75d already deleted. [ 627.243071] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30d1cd1e-09a2-449c-b797-27d65483b75d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.699066] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('386f2bfa-81a7-40ba-a9a8-a207890c2528',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.729024] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb6f8ce6-311d-4e8e-b179-b86a971739cb in Status: SUCCESS [ 627.729024] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb6f8ce6-311d-4e8e-b179-b86a971739cb deletion is rescheduled due to dependency. [ 627.729024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.204097] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 386f2bfa-81a7-40ba-a9a8-a207890c2528: rpc.has_security_group_logging(os_id): False [ 628.227554] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.227774] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.227877] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.228260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.228366] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.228726] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.228880] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.228981] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.229198] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.229319] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.229382] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 is going to be created. [ 628.305489] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 in Status: SUCCESS [ 628.305726] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.323156] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.323156] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.323156] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.323156] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.323156] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.341520] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 in Status: IN_PROGRESS for 2s [ 629.123530] env[66834]: INFO networking_nsxv3.common.synchronization [req-b871d179-e265-47a2-ae12-4d1d4e6ee539 req-f359f50b-917b-4bdc-9753-ce1685a40a44 tempest-InstanceActionsV221TestJSON-163739217 tempest-InstanceActionsV221TestJSON-163739217-project-member] Enqueued Resource ID: 240d0ecb-120a-48a6-aeb4-265ef374eeb1 with Priority: HIGHEST for action security_group_members [ 629.124346] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 240d0ecb-120a-48a6-aeb4-265ef374eeb1 with Priority: HIGHEST for action security_group_members [ 629.124506] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-240d0ecb-120a-48a6-aeb4-265ef374eeb1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.125492] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.125492] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.125492] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.125719] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.125719] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.125811] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.125904] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.125991] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.126106] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('240d0ecb-120a-48a6-aeb4-265ef374eeb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.215278] env[66834]: INFO networking_nsxv3.common.synchronization [None req-b757aff0-b8fb-4938-ba0c-3bc584589874 None None] Enqueued Resource ID: aa669bb8-3fde-43f4-9b31-586010a383c3 with Priority: HIGHEST for action port [ 629.215646] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa669bb8-3fde-43f4-9b31-586010a383c3 with Priority: HIGHEST for action port [ 629.216033] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa669bb8-3fde-43f4-9b31-586010a383c3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.216033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa669bb8-3fde-43f4-9b31-586010a383c3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.216235] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa669bb8-3fde-43f4-9b31-586010a383c3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.216425] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa669bb8-3fde-43f4-9b31-586010a383c3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.216508] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa669bb8-3fde-43f4-9b31-586010a383c3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.631538] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.631538] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.631538] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.631538] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.631538] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.631538] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.631538] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.631538] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.631538] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.631538] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.631538] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 240d0ecb-120a-48a6-aeb4-265ef374eeb1 is going to be updated. [ 629.660112] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.660112] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.660112] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.660112] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.660112] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.670963] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 240d0ecb-120a-48a6-aeb4-265ef374eeb1 in Status: IN_PROGRESS for 2s [ 629.720124] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa669bb8-3fde-43f4-9b31-586010a383c3 [ 629.720377] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.720513] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.720598] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.720831] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.720925] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.721066] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa669bb8-3fde-43f4-9b31-586010a383c3 already deleted. [ 629.721135] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa669bb8-3fde-43f4-9b31-586010a383c3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.356431] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 in Status: SUCCESS [ 630.356431] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.664979] env[66834]: INFO networking_nsxv3.common.synchronization [None req-cc03f7dd-90e4-4ba2-a6ee-03db830b57b1 None None] Enqueued Resource ID: ed7f952c-f87d-44cd-b7d3-ec74c9e9247c with Priority: HIGHEST for action port [ 631.665370] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed7f952c-f87d-44cd-b7d3-ec74c9e9247c with Priority: HIGHEST for action port [ 631.665702] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed7f952c-f87d-44cd-b7d3-ec74c9e9247c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.665855] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed7f952c-f87d-44cd-b7d3-ec74c9e9247c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.665943] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed7f952c-f87d-44cd-b7d3-ec74c9e9247c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.666289] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed7f952c-f87d-44cd-b7d3-ec74c9e9247c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.666383] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed7f952c-f87d-44cd-b7d3-ec74c9e9247c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.681244] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 240d0ecb-120a-48a6-aeb4-265ef374eeb1 in Status: SUCCESS [ 631.681448] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 240d0ecb-120a-48a6-aeb4-265ef374eeb1 deletion is rescheduled due to dependency. [ 631.682233] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.169752] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed7f952c-f87d-44cd-b7d3-ec74c9e9247c [ 632.170250] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.170250] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.170378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.170603] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.170745] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.170869] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed7f952c-f87d-44cd-b7d3-ec74c9e9247c already deleted. [ 632.170987] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed7f952c-f87d-44cd-b7d3-ec74c9e9247c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.207330] env[66834]: INFO networking_nsxv3.common.synchronization [None req-974c2d99-94e5-42fc-92ee-a46f7ae27211 None None] Enqueued Resource ID: 39cdee9e-ab7a-47a9-8118-ec9fc828daa2 with Priority: HIGHEST for action port [ 632.207874] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39cdee9e-ab7a-47a9-8118-ec9fc828daa2 with Priority: HIGHEST for action port [ 632.208233] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-39cdee9e-ab7a-47a9-8118-ec9fc828daa2 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.208380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39cdee9e-ab7a-47a9-8118-ec9fc828daa2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.208473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39cdee9e-ab7a-47a9-8118-ec9fc828daa2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.209247] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39cdee9e-ab7a-47a9-8118-ec9fc828daa2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.209346] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39cdee9e-ab7a-47a9-8118-ec9fc828daa2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.712697] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39cdee9e-ab7a-47a9-8118-ec9fc828daa2 [ 632.713014] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.713103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.713174] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.713384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.713467] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.713557] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39cdee9e-ab7a-47a9-8118-ec9fc828daa2 already deleted. [ 632.713641] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39cdee9e-ab7a-47a9-8118-ec9fc828daa2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.217956] env[66834]: INFO networking_nsxv3.common.synchronization [req-3de541e9-82e8-4dc8-b16d-4da3ffdbe52f req-5801d980-5906-4679-84ac-83f25fa51f2a tempest-ServersWithSpecificFlavorTestJSON-2029331566 tempest-ServersWithSpecificFlavorTestJSON-2029331566-project-member] Enqueued Resource ID: 9c3590f1-016a-4b00-b83e-f52f030b948b with Priority: HIGHEST for action security_group_members [ 633.219968] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c3590f1-016a-4b00-b83e-f52f030b948b with Priority: HIGHEST for action security_group_members [ 633.219968] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c3590f1-016a-4b00-b83e-f52f030b948b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.219968] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.219968] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.219968] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.219968] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.219968] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.219968] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.220465] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.220465] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.220714] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c3590f1-016a-4b00-b83e-f52f030b948b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.617432] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-316 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.617432] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-316" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.617432] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-316" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.617432] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-316" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.617432] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.617432] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.617432] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.617432] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.621030] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.621262] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.621376] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 633.621482] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 633.621583] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 633.621711] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.622125] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 633.622125] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 633.643274] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 633.644056] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 633.644056] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 633.644056] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-316" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.644056] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-09d3ec74-fec4-4752-9d2b-6084351eaf92 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.644275] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-09d3ec74-fec4-4752-9d2b-6084351eaf92" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.644321] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-09d3ec74-fec4-4752-9d2b-6084351eaf92" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.644610] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-09d3ec74-fec4-4752-9d2b-6084351eaf92" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.644741] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09d3ec74-fec4-4752-9d2b-6084351eaf92',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.724439] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.724884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.725010] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.725458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.725623] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.725781] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.725912] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.725978] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.726137] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.726216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.726302] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c3590f1-016a-4b00-b83e-f52f030b948b already deleted. [ 633.726382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.146425] env[66834]: INFO networking_nsxv3.common.synchronization [None req-8c1b0a83-a68c-4115-84bd-ef0c6303ff82 None None] Enqueued Resource ID: 3827ec3e-3d25-4651-a2e1-c8a4c6ebf9fa with Priority: HIGHEST for action port [ 634.147073] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.150442] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.150442] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.150442] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.150442] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.150442] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 09d3ec74-fec4-4752-9d2b-6084351eaf92 not found, creating... [ 634.150442] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.150442] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.150442] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.150442] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.150442] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.152048] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.152048] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.152048] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.152048] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.152048] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.152048] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 09d3ec74-fec4-4752-9d2b-6084351eaf92 is going to be created. [ 634.153390] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3827ec3e-3d25-4651-a2e1-c8a4c6ebf9fa with Priority: HIGHEST for action port [ 634.153777] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-3827ec3e-3d25-4651-a2e1-c8a4c6ebf9fa taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.153896] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3827ec3e-3d25-4651-a2e1-c8a4c6ebf9fa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.153966] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3827ec3e-3d25-4651-a2e1-c8a4c6ebf9fa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.154281] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3827ec3e-3d25-4651-a2e1-c8a4c6ebf9fa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.154379] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3827ec3e-3d25-4651-a2e1-c8a4c6ebf9fa',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.180034] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.180034] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.180034] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.180034] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.180034] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.180034] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-09d3ec74-fec4-4752-9d2b-6084351eaf92" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.655066] env[66834]: INFO networking_nsxv3.common.synchronization [None req-670d0b23-0901-4573-99f0-ebf1338831ef None None] Enqueued Resource ID: 768a0930-4030-4fff-ba9f-4edc63ead64b with Priority: HIGHEST for action port [ 634.655869] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 768a0930-4030-4fff-ba9f-4edc63ead64b with Priority: HIGHEST for action port [ 634.656867] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3827ec3e-3d25-4651-a2e1-c8a4c6ebf9fa [ 634.657966] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.658234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.660832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.660832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.660832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.660832] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3827ec3e-3d25-4651-a2e1-c8a4c6ebf9fa already deleted. [ 634.660832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3827ec3e-3d25-4651-a2e1-c8a4c6ebf9fa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.660832] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-768a0930-4030-4fff-ba9f-4edc63ead64b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.660832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-768a0930-4030-4fff-ba9f-4edc63ead64b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.660832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-768a0930-4030-4fff-ba9f-4edc63ead64b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.660832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-768a0930-4030-4fff-ba9f-4edc63ead64b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.660832] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('768a0930-4030-4fff-ba9f-4edc63ead64b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.909323] env[66834]: INFO networking_nsxv3.common.synchronization [req-3de541e9-82e8-4dc8-b16d-4da3ffdbe52f req-2d0df30e-5d97-4943-8193-4a00921581f4 service nova] Enqueued Resource ID: 9c3590f1-016a-4b00-b83e-f52f030b948b with Priority: HIGHEST for action security_group_rules [ 634.909323] env[66834]: INFO networking_nsxv3.common.synchronization [req-3de541e9-82e8-4dc8-b16d-4da3ffdbe52f req-2d0df30e-5d97-4943-8193-4a00921581f4 service nova] Enqueued Resource ID: 9c3590f1-016a-4b00-b83e-f52f030b948b with Priority: HIGHEST for action security_group_members [ 634.909323] env[66834]: INFO networking_nsxv3.common.synchronization [req-3de541e9-82e8-4dc8-b16d-4da3ffdbe52f req-2d0df30e-5d97-4943-8193-4a00921581f4 service nova] Enqueued Resource ID: 09d3ec74-fec4-4752-9d2b-6084351eaf92 with Priority: HIGHEST for action port [ 634.909323] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c3590f1-016a-4b00-b83e-f52f030b948b with Priority: HIGHEST for action security_group_rules [ 634.910767] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c3590f1-016a-4b00-b83e-f52f030b948b with Priority: HIGHEST for action security_group_members [ 634.911032] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09d3ec74-fec4-4752-9d2b-6084351eaf92 with Priority: HIGHEST for action port [ 634.911445] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c3590f1-016a-4b00-b83e-f52f030b948b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.911780] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.912129] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.915392] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.915392] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c3590f1-016a-4b00-b83e-f52f030b948b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.915392] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c3590f1-016a-4b00-b83e-f52f030b948b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.915392] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.915392] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.915392] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.915392] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.915392] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.915392] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.915392] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.915392] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.915392] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c3590f1-016a-4b00-b83e-f52f030b948b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.916707] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-09d3ec74-fec4-4752-9d2b-6084351eaf92 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.916707] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09d3ec74-fec4-4752-9d2b-6084351eaf92" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.916707] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09d3ec74-fec4-4752-9d2b-6084351eaf92" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.917017] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09d3ec74-fec4-4752-9d2b-6084351eaf92" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.917017] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09d3ec74-fec4-4752-9d2b-6084351eaf92',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.099297] env[66834]: INFO networking_nsxv3.common.synchronization [req-4c2cb306-6aa5-4670-be43-fc7af725b4b5 req-52242b63-d8c7-4ea7-8d95-aae9660f7cf4 tempest-FloatingIPsAssociationNegativeTestJSON-59745517 tempest-FloatingIPsAssociationNegativeTestJSON-59745517-project-member] Enqueued Resource ID: 2bf0f195-54b8-49b4-bd78-a433a8df0ce0 with Priority: HIGHEST for action security_group_members [ 635.099895] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bf0f195-54b8-49b4-bd78-a433a8df0ce0 with Priority: HIGHEST for action security_group_members [ 635.100248] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.100395] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.100467] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.100731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.100907] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.103135] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.103135] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.103135] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.103135] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.103135] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bf0f195-54b8-49b4-bd78-a433a8df0ce0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.161431] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 768a0930-4030-4fff-ba9f-4edc63ead64b [ 635.161661] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.161807] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.161881] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.162116] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.162207] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.162302] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:768a0930-4030-4fff-ba9f-4edc63ead64b already deleted. [ 635.162386] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-768a0930-4030-4fff-ba9f-4edc63ead64b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.419245] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c3590f1-016a-4b00-b83e-f52f030b948b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.420599] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c3590f1-016a-4b00-b83e-f52f030b948b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.420756] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.421219] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09d3ec74-fec4-4752-9d2b-6084351eaf92 with status ACTIVE [ 635.421451] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.421636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.421778] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.422025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.422160] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.422393] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.422685] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.422685] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.422855] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.422967] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.423217] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.423356] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.423451] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.423663] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.423778] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.423900] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09d3ec74-fec4-4752-9d2b-6084351eaf92 is going to be updated. [ 635.441116] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-360 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.441262] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-360" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.441375] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-360" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.441715] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-360" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.442125] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.442310] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.442445] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.442646] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.442786] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.442989] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 635.443114] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 635.443218] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 635.443319] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 635.443433] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 635.443537] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 635.443657] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 635.445684] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.445806] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.445863] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.447739] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.447739] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.447739] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09d3ec74-fec4-4752-9d2b-6084351eaf92" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.466097] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 635.467031] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 635.467155] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 635.467526] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-360" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.467719] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-141554a4-0938-40a0-9720-0cb71a570c1e taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.467873] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-141554a4-0938-40a0-9720-0cb71a570c1e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.467997] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-141554a4-0938-40a0-9720-0cb71a570c1e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.468334] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-141554a4-0938-40a0-9720-0cb71a570c1e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.468469] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('141554a4-0938-40a0-9720-0cb71a570c1e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.604802] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.604995] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.605083] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.605307] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.605398] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.606086] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.606244] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.606312] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.606508] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.606555] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.606645] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bf0f195-54b8-49b4-bd78-a433a8df0ce0 already deleted. [ 635.606724] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.843454] env[66834]: INFO networking_nsxv3.common.synchronization [None req-6db8a155-7614-4ed9-a36e-ab4182a62959 None None] Enqueued Resource ID: 04f6dfdb-fc16-4af0-bbc6-a9e9806c0d97 with Priority: HIGHEST for action port [ 635.844265] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04f6dfdb-fc16-4af0-bbc6-a9e9806c0d97 with Priority: HIGHEST for action port [ 635.844873] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-04f6dfdb-fc16-4af0-bbc6-a9e9806c0d97 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.845268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04f6dfdb-fc16-4af0-bbc6-a9e9806c0d97" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.845459] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04f6dfdb-fc16-4af0-bbc6-a9e9806c0d97" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.845861] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04f6dfdb-fc16-4af0-bbc6-a9e9806c0d97" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.846363] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04f6dfdb-fc16-4af0-bbc6-a9e9806c0d97',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.924420] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c3590f1-016a-4b00-b83e-f52f030b948b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.971266] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.971481] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.971597] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.971904] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.972275] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.972275] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 141554a4-0938-40a0-9720-0cb71a570c1e not found, creating... [ 635.972443] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.972578] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.972684] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.972896] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.973038] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.973374] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.973462] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.974026] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.974026] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.974026] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.974026] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 141554a4-0938-40a0-9720-0cb71a570c1e is going to be created. [ 635.998425] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.998689] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.998816] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.999104] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.999337] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.999587] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-141554a4-0938-40a0-9720-0cb71a570c1e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.292403] env[66834]: INFO networking_nsxv3.common.synchronization [None req-6d03f4d4-fdae-4c9e-a102-794b82284762 None None] Enqueued Resource ID: 13c43e02-5a94-48e5-8e6d-fbc23dc999fa with Priority: HIGHEST for action port [ 636.292403] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13c43e02-5a94-48e5-8e6d-fbc23dc999fa with Priority: HIGHEST for action port [ 636.292403] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-13c43e02-5a94-48e5-8e6d-fbc23dc999fa taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.292403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13c43e02-5a94-48e5-8e6d-fbc23dc999fa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.292403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13c43e02-5a94-48e5-8e6d-fbc23dc999fa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.292403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13c43e02-5a94-48e5-8e6d-fbc23dc999fa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.292403] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13c43e02-5a94-48e5-8e6d-fbc23dc999fa',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.348654] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04f6dfdb-fc16-4af0-bbc6-a9e9806c0d97 [ 636.349094] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.349851] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.349851] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.349851] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.349851] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.349851] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:04f6dfdb-fc16-4af0-bbc6-a9e9806c0d97 already deleted. [ 636.350071] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04f6dfdb-fc16-4af0-bbc6-a9e9806c0d97" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.433094] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.433094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.433094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.433094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.433094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.433094] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c3590f1-016a-4b00-b83e-f52f030b948b is going to be created. [ 636.457644] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.457832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.457876] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.458099] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.458250] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.470515] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c3590f1-016a-4b00-b83e-f52f030b948b in Status: UNINITIALIZED for 2s [ 636.750889] env[66834]: INFO networking_nsxv3.common.synchronization [req-4c2cb306-6aa5-4670-be43-fc7af725b4b5 req-79690e35-c26d-43c1-a4de-93dbbec67e4c service nova] Enqueued Resource ID: 2bf0f195-54b8-49b4-bd78-a433a8df0ce0 with Priority: HIGHEST for action security_group_rules [ 636.751064] env[66834]: INFO networking_nsxv3.common.synchronization [req-4c2cb306-6aa5-4670-be43-fc7af725b4b5 req-79690e35-c26d-43c1-a4de-93dbbec67e4c service nova] Enqueued Resource ID: 2bf0f195-54b8-49b4-bd78-a433a8df0ce0 with Priority: HIGHEST for action security_group_members [ 636.752412] env[66834]: INFO networking_nsxv3.common.synchronization [req-4c2cb306-6aa5-4670-be43-fc7af725b4b5 req-79690e35-c26d-43c1-a4de-93dbbec67e4c service nova] Enqueued Resource ID: 141554a4-0938-40a0-9720-0cb71a570c1e with Priority: HIGHEST for action port [ 636.752412] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bf0f195-54b8-49b4-bd78-a433a8df0ce0 with Priority: HIGHEST for action security_group_rules [ 636.752412] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bf0f195-54b8-49b4-bd78-a433a8df0ce0 with Priority: HIGHEST for action security_group_members [ 636.752412] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 141554a4-0938-40a0-9720-0cb71a570c1e with Priority: HIGHEST for action port [ 636.753267] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bf0f195-54b8-49b4-bd78-a433a8df0ce0 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.753457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.753499] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.753750] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.753852] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bf0f195-54b8-49b4-bd78-a433a8df0ce0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.756589] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.756589] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.756589] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.756589] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.756746] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.757724] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.757724] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.757724] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.757724] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.757724] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bf0f195-54b8-49b4-bd78-a433a8df0ce0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.760104] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-141554a4-0938-40a0-9720-0cb71a570c1e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.760328] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-141554a4-0938-40a0-9720-0cb71a570c1e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.760409] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-141554a4-0938-40a0-9720-0cb71a570c1e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.760590] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-141554a4-0938-40a0-9720-0cb71a570c1e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.760665] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('141554a4-0938-40a0-9720-0cb71a570c1e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.795240] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 13c43e02-5a94-48e5-8e6d-fbc23dc999fa [ 636.795859] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.795859] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.795859] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.796664] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.796762] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.796864] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:13c43e02-5a94-48e5-8e6d-fbc23dc999fa already deleted. [ 636.796933] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13c43e02-5a94-48e5-8e6d-fbc23dc999fa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.257377] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.257747] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.264020] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2bf0f195-54b8-49b4-bd78-a433a8df0ce0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.266486] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 141554a4-0938-40a0-9720-0cb71a570c1e with status ACTIVE [ 637.267381] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.267834] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.268106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.268545] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.271029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.271029] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.271029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.271029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.271029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.271029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.271029] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.271029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.271029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.271029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.271029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.271029] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 141554a4-0938-40a0-9720-0cb71a570c1e is going to be updated. [ 637.296108] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.296108] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.296108] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.296255] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.296378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.296592] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-141554a4-0938-40a0-9720-0cb71a570c1e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.362395] env[66834]: INFO networking_nsxv3.common.synchronization [req-f561286c-e4f1-4e3f-8954-ecc088f996f6 req-7e1cf597-cd99-41d9-871f-e44ae066fec8 tempest-ServerExternalEventsTest-1206431056 tempest-ServerExternalEventsTest-1206431056-project-member] Enqueued Resource ID: 1262896d-5f2c-4d6b-8695-adeea78ba3f6 with Priority: HIGHEST for action security_group_members [ 637.363058] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1262896d-5f2c-4d6b-8695-adeea78ba3f6 with Priority: HIGHEST for action security_group_members [ 637.363369] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1262896d-5f2c-4d6b-8695-adeea78ba3f6 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.363494] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.363553] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.363810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.364793] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.364793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.364793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.364793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.364793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.364793] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1262896d-5f2c-4d6b-8695-adeea78ba3f6',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.773815] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2bf0f195-54b8-49b4-bd78-a433a8df0ce0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.866715] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.867101] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.867101] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.867276] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.867382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.867620] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.867727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.867793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.867962] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.868052] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.868136] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1262896d-5f2c-4d6b-8695-adeea78ba3f6 already deleted. [ 637.868217] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.914962] env[66834]: INFO networking_nsxv3.common.synchronization [None req-c0a8686d-1e44-4ce0-899c-61de1b6eda52 None None] Enqueued Resource ID: a520a203-db44-4166-a484-395cc4c94b4e with Priority: HIGHEST for action port [ 637.915402] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a520a203-db44-4166-a484-395cc4c94b4e with Priority: HIGHEST for action port [ 637.915705] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-a520a203-db44-4166-a484-395cc4c94b4e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.915875] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a520a203-db44-4166-a484-395cc4c94b4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.915946] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a520a203-db44-4166-a484-395cc4c94b4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.919797] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a520a203-db44-4166-a484-395cc4c94b4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.919901] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a520a203-db44-4166-a484-395cc4c94b4e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.005210] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-582 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.006488] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.006488] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.006488] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.006488] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.006488] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.006896] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.007173] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.007568] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.007568] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.007698] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 638.007749] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 638.007846] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 638.007940] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.008045] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 638.008163] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 638.030161] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 638.030320] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 638.030449] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 638.030616] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.030918] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-51956986-2307-4ea2-8797-96d1735361bc taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.031095] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-51956986-2307-4ea2-8797-96d1735361bc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.031205] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-51956986-2307-4ea2-8797-96d1735361bc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.031516] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-51956986-2307-4ea2-8797-96d1735361bc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.031676] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51956986-2307-4ea2-8797-96d1735361bc',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.276645] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.276919] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.276919] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.277146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.277191] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.277288] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bf0f195-54b8-49b4-bd78-a433a8df0ce0 is going to be created. [ 638.306884] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.307082] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.307163] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.307427] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.307680] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.324010] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bf0f195-54b8-49b4-bd78-a433a8df0ce0 in Status: UNINITIALIZED for 2s [ 638.424175] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a520a203-db44-4166-a484-395cc4c94b4e [ 638.424175] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.424175] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.424175] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.424357] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.424524] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.425176] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a520a203-db44-4166-a484-395cc4c94b4e already deleted. [ 638.425176] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a520a203-db44-4166-a484-395cc4c94b4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.480969] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c3590f1-016a-4b00-b83e-f52f030b948b in Status: SUCCESS [ 638.481370] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.481370] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.481773] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.481988] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.482181] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.482275] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.482477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.482569] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.482659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.482763] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c3590f1-016a-4b00-b83e-f52f030b948b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.535374] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.535374] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.535374] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.535374] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.535374] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.535374] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 51956986-2307-4ea2-8797-96d1735361bc not found, creating... [ 638.535374] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.535847] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.535847] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.536125] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.536288] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.536994] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.536994] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.537285] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.537441] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.537732] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.537938] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 51956986-2307-4ea2-8797-96d1735361bc is going to be created. [ 638.563271] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.563493] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.563638] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.563905] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.564139] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.564359] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-51956986-2307-4ea2-8797-96d1735361bc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.984550] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c3590f1-016a-4b00-b83e-f52f030b948b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.288022] env[66834]: INFO networking_nsxv3.common.synchronization [req-f561286c-e4f1-4e3f-8954-ecc088f996f6 req-20df5263-0353-48df-be3a-6bcd9ff1030e service nova] Enqueued Resource ID: 1262896d-5f2c-4d6b-8695-adeea78ba3f6 with Priority: HIGHEST for action security_group_rules [ 639.288022] env[66834]: INFO networking_nsxv3.common.synchronization [req-f561286c-e4f1-4e3f-8954-ecc088f996f6 req-20df5263-0353-48df-be3a-6bcd9ff1030e service nova] Enqueued Resource ID: 1262896d-5f2c-4d6b-8695-adeea78ba3f6 with Priority: HIGHEST for action security_group_members [ 639.288022] env[66834]: INFO networking_nsxv3.common.synchronization [req-f561286c-e4f1-4e3f-8954-ecc088f996f6 req-20df5263-0353-48df-be3a-6bcd9ff1030e service nova] Enqueued Resource ID: 51956986-2307-4ea2-8797-96d1735361bc with Priority: HIGHEST for action port [ 639.288022] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1262896d-5f2c-4d6b-8695-adeea78ba3f6 with Priority: HIGHEST for action security_group_rules [ 639.288022] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1262896d-5f2c-4d6b-8695-adeea78ba3f6 with Priority: HIGHEST for action security_group_members [ 639.288022] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51956986-2307-4ea2-8797-96d1735361bc with Priority: HIGHEST for action port [ 639.288022] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1262896d-5f2c-4d6b-8695-adeea78ba3f6 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.288022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.288022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.288022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.288022] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1262896d-5f2c-4d6b-8695-adeea78ba3f6',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.288847] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1262896d-5f2c-4d6b-8695-adeea78ba3f6 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.288847] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.288847] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.289581] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.289639] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.289700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.289763] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.289924] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.290020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.290116] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1262896d-5f2c-4d6b-8695-adeea78ba3f6',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.291632] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-51956986-2307-4ea2-8797-96d1735361bc taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.291768] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51956986-2307-4ea2-8797-96d1735361bc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.291825] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51956986-2307-4ea2-8797-96d1735361bc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.291953] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51956986-2307-4ea2-8797-96d1735361bc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.292059] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51956986-2307-4ea2-8797-96d1735361bc',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.488693] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c3590f1-016a-4b00-b83e-f52f030b948b: rpc.has_security_group_logging(os_id): False [ 639.507885] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.508094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.508094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.508508] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.508508] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.508648] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.508721] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.508760] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.508892] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.509581] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.509581] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c3590f1-016a-4b00-b83e-f52f030b948b is going to be created. [ 639.582822] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.583336] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.583336] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.583336] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.583613] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.596099] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c3590f1-016a-4b00-b83e-f52f030b948b in Status: IN_PROGRESS for 2s [ 639.792419] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1262896d-5f2c-4d6b-8695-adeea78ba3f6',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.794247] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1262896d-5f2c-4d6b-8695-adeea78ba3f6 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.794403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.794516] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51956986-2307-4ea2-8797-96d1735361bc with status ACTIVE [ 639.794682] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.794841] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.794841] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.795143] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.795227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.795476] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.795685] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.795737] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.795931] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.796036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.796225] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.796322] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.796379] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.796535] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.796709] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.796709] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51956986-2307-4ea2-8797-96d1735361bc is going to be updated. [ 639.806482] env[66834]: INFO networking_nsxv3.common.synchronization [None req-3c0b126d-36cd-416c-b90c-1b6832375e63 None None] Enqueued Resource ID: fd63cff4-b269-4aa8-ad66-ce4578d2175e with Priority: HIGHEST for action port [ 639.807936] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd63cff4-b269-4aa8-ad66-ce4578d2175e with Priority: HIGHEST for action port [ 639.807936] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd63cff4-b269-4aa8-ad66-ce4578d2175e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.807936] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd63cff4-b269-4aa8-ad66-ce4578d2175e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.807936] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd63cff4-b269-4aa8-ad66-ce4578d2175e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.809572] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd63cff4-b269-4aa8-ad66-ce4578d2175e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.809836] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd63cff4-b269-4aa8-ad66-ce4578d2175e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.820802] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.821525] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.821525] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.822770] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.822770] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.822770] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51956986-2307-4ea2-8797-96d1735361bc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.033300] env[66834]: INFO networking_nsxv3.common.synchronization [req-71b4fb14-b4fc-4494-afca-9707b09cec76 req-f286f143-2991-4b90-abfd-385a3d617a0b tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 640.034197] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 640.035070] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.035070] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.035070] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.035440] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.035574] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.035695] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.035811] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.036708] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.036884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.037313] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.117683] env[66834]: INFO networking_nsxv3.common.synchronization [None req-7ced820b-b55d-49b1-b012-7fd5ffc18b50 None None] Enqueued Resource ID: 6813cf9d-fe8a-430c-aa5d-a14361e33b25 with Priority: HIGHEST for action port [ 640.118464] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6813cf9d-fe8a-430c-aa5d-a14361e33b25 with Priority: HIGHEST for action port [ 640.118696] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-6813cf9d-fe8a-430c-aa5d-a14361e33b25 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.118882] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6813cf9d-fe8a-430c-aa5d-a14361e33b25" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.118929] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6813cf9d-fe8a-430c-aa5d-a14361e33b25" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.119253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6813cf9d-fe8a-430c-aa5d-a14361e33b25" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.119372] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6813cf9d-fe8a-430c-aa5d-a14361e33b25',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.299692] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1262896d-5f2c-4d6b-8695-adeea78ba3f6',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.313206] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd63cff4-b269-4aa8-ad66-ce4578d2175e [ 640.313206] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.313206] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.313206] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.313206] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.313206] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.313206] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd63cff4-b269-4aa8-ad66-ce4578d2175e already deleted. [ 640.313206] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd63cff4-b269-4aa8-ad66-ce4578d2175e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.336519] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bf0f195-54b8-49b4-bd78-a433a8df0ce0 in Status: SUCCESS [ 640.336519] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.336519] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.336519] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.336519] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.336519] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.337162] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.337162] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.337162] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.337162] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.337162] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2bf0f195-54b8-49b4-bd78-a433a8df0ce0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.542058] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.542058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.542058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.542058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.542058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.542058] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.542058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.542058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.542058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.542058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.542058] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21deb826-26b5-4246-96bf-34da6682babd already deleted. [ 640.542058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.552227] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-403 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.552406] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-403" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.552518] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-403" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.552850] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-403" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.553465] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.554619] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.554619] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.554619] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.554619] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.554619] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.554619] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 640.554619] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 640.554619] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 640.554947] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.554947] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 640.554947] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 640.577198] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 640.577353] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 640.577486] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 640.577685] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-403" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.577991] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-3e3a239a-6a6f-436a-a9dc-55323b244ad8 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.578173] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-3e3a239a-6a6f-436a-a9dc-55323b244ad8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.578291] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-3e3a239a-6a6f-436a-a9dc-55323b244ad8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.578597] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-3e3a239a-6a6f-436a-a9dc-55323b244ad8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.578737] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e3a239a-6a6f-436a-a9dc-55323b244ad8',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.623501] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6813cf9d-fe8a-430c-aa5d-a14361e33b25 [ 640.623501] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.623501] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.623501] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.623501] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.623501] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.623501] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6813cf9d-fe8a-430c-aa5d-a14361e33b25 already deleted. [ 640.623501] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6813cf9d-fe8a-430c-aa5d-a14361e33b25" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.801764] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.802594] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.802594] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.802594] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.802594] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.802854] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1262896d-5f2c-4d6b-8695-adeea78ba3f6 is going to be created. [ 640.829707] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.829707] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.829707] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.829972] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.830450] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.839921] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.841023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.841023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.841023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.841023] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.841315] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.841465] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.841883] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.842041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.842299] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.842732] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.843051] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.843226] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.843498] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.843781] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.843923] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.844040] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.844295] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.844424] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.844651] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.844799] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2bf0f195-54b8-49b4-bd78-a433a8df0ce0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.846388] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1262896d-5f2c-4d6b-8695-adeea78ba3f6 in Status: UNINITIALIZED for 2s [ 641.080685] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.081585] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.081585] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.082153] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.082320] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.082946] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 3e3a239a-6a6f-436a-a9dc-55323b244ad8 not found, creating... [ 641.083146] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.083690] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.083690] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.084237] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.084237] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.084826] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.084826] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.085134] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.086017] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.086107] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.086269] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 3e3a239a-6a6f-436a-a9dc-55323b244ad8 is going to be created. [ 641.111173] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.111641] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.111918] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.112491] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.112755] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.113095] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-3e3a239a-6a6f-436a-a9dc-55323b244ad8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.348116] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2bf0f195-54b8-49b4-bd78-a433a8df0ce0: rpc.has_security_group_logging(os_id): False [ 641.376876] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.377126] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.377181] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.377685] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.377886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.378171] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.378302] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.378369] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.378566] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.378808] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.379152] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.379295] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.379382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.380458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.380458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.380458] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.380458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.380458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.380458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.380458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.380458] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bf0f195-54b8-49b4-bd78-a433a8df0ce0 is going to be created. [ 641.484205] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.484205] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.484358] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.484474] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.485288] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.504795] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2bf0f195-54b8-49b4-bd78-a433a8df0ce0 in Status: IN_PROGRESS for 2s [ 641.612350] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c3590f1-016a-4b00-b83e-f52f030b948b in Status: SUCCESS [ 641.612583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.283164] env[66834]: INFO networking_nsxv3.common.synchronization [req-71b4fb14-b4fc-4494-afca-9707b09cec76 req-8759cfa0-4228-480c-999d-e292a00ded8a service nova] Enqueued Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_rules [ 642.283346] env[66834]: INFO networking_nsxv3.common.synchronization [req-71b4fb14-b4fc-4494-afca-9707b09cec76 req-8759cfa0-4228-480c-999d-e292a00ded8a service nova] Enqueued Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 642.283478] env[66834]: INFO networking_nsxv3.common.synchronization [req-71b4fb14-b4fc-4494-afca-9707b09cec76 req-8759cfa0-4228-480c-999d-e292a00ded8a service nova] Enqueued Resource ID: 3e3a239a-6a6f-436a-a9dc-55323b244ad8 with Priority: HIGHEST for action port [ 642.284072] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_rules [ 642.285621] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 642.285621] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3a239a-6a6f-436a-a9dc-55323b244ad8 with Priority: HIGHEST for action port [ 642.285621] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.285621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.285621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.285621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.285621] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.287999] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.289175] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.289175] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.289175] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.290828] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.290828] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.290828] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.290828] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.290828] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.290828] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.292617] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e3a239a-6a6f-436a-a9dc-55323b244ad8 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.292617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e3a239a-6a6f-436a-a9dc-55323b244ad8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.292617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e3a239a-6a6f-436a-a9dc-55323b244ad8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.293658] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e3a239a-6a6f-436a-a9dc-55323b244ad8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.293658] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e3a239a-6a6f-436a-a9dc-55323b244ad8',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.798586] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.798586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.798586] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.798586] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e3a239a-6a6f-436a-a9dc-55323b244ad8 with status ACTIVE [ 642.798586] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.799147] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.799147] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.799265] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.799379] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.799568] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.799673] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.799724] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.799915] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.801167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.801167] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.801167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.801167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.801167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.801167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.801167] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e3a239a-6a6f-436a-a9dc-55323b244ad8 is going to be updated. [ 642.827676] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.827676] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.827676] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.827676] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.827676] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.827676] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e3a239a-6a6f-436a-a9dc-55323b244ad8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.857561] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1262896d-5f2c-4d6b-8695-adeea78ba3f6 in Status: SUCCESS [ 642.857874] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.858059] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.858333] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.858528] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.859103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.859103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.859103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.859399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.859399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.859503] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1262896d-5f2c-4d6b-8695-adeea78ba3f6',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.097749] env[66834]: INFO networking_nsxv3.common.synchronization [req-9a9f83ba-c3d2-40f8-bcf1-a252d9c4be41 req-f4d301a9-b734-4ee3-9d68-542be20d1a33 tempest-SecurityGroupRulesTestJSON-770145699 tempest-SecurityGroupRulesTestJSON-770145699-project-member] Enqueued Resource ID: a7b64f4c-925a-4d08-9bbb-343b7a132bec with Priority: HIGHEST for action security_group_rules [ 643.098038] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7b64f4c-925a-4d08-9bbb-343b7a132bec with Priority: HIGHEST for action security_group_rules [ 643.098659] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7b64f4c-925a-4d08-9bbb-343b7a132bec taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.098804] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7b64f4c-925a-4d08-9bbb-343b7a132bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.098804] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7b64f4c-925a-4d08-9bbb-343b7a132bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.099097] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7b64f4c-925a-4d08-9bbb-343b7a132bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.099207] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7b64f4c-925a-4d08-9bbb-343b7a132bec',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.304282] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.363795] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1262896d-5f2c-4d6b-8695-adeea78ba3f6 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.363795] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.363795] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.363795] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.363795] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.363795] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.363795] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.363795] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.363795] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.364176] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.364176] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1262896d-5f2c-4d6b-8695-adeea78ba3f6 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.364176] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.364176] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.364437] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.364437] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.364540] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.364576] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.364905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.364905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.364905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.365093] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1262896d-5f2c-4d6b-8695-adeea78ba3f6',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.527197] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2bf0f195-54b8-49b4-bd78-a433a8df0ce0 in Status: SUCCESS [ 643.527197] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.620765] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.620996] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.620996] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.621428] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.621428] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.621622] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7b64f4c-925a-4d08-9bbb-343b7a132bec already deleted. [ 643.621622] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7b64f4c-925a-4d08-9bbb-343b7a132bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.807695] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.807695] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.807695] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.808162] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.808162] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.808162] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21deb826-26b5-4246-96bf-34da6682babd is going to be created. [ 643.837885] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.838072] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.838129] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.838331] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.838565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.852660] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: UNINITIALIZED for 2s [ 643.868357] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1262896d-5f2c-4d6b-8695-adeea78ba3f6: rpc.has_security_group_logging(os_id): False [ 643.888103] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.888296] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.888296] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.888469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.888599] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.888820] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.888941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.889298] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.889298] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.889298] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.889579] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.893019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.893019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.893019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.893019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.893019] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.893019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.893019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.893019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.893019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.893019] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1262896d-5f2c-4d6b-8695-adeea78ba3f6 is going to be created. [ 643.956161] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.957048] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.957048] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.957048] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.957048] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.973146] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1262896d-5f2c-4d6b-8695-adeea78ba3f6 in Status: IN_PROGRESS for 2s [ 644.547405] env[66834]: INFO networking_nsxv3.common.synchronization [req-b445fa43-ecd3-497a-920c-083596a31d4f req-78166122-af12-4dc9-9935-adf3afceb542 tempest-AttachInterfacesUnderV243Test-828580212 tempest-AttachInterfacesUnderV243Test-828580212-project-member] Enqueued Resource ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 with Priority: HIGHEST for action security_group_members [ 644.547882] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 with Priority: HIGHEST for action security_group_members [ 644.548240] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.548372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.548449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.548754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.548952] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.549085] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.549085] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.549202] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.549294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.549384] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9117e7f6-fbaa-44a8-bc92-e3fb9acd2228',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.971487] env[66834]: INFO networking_nsxv3.common.synchronization [None req-2fd7159d-d531-4989-86c5-471b810fdb04 None None] Enqueued Resource ID: 0128e3a8-c4c6-47a3-8a1e-e89ed2797a92 with Priority: HIGHEST for action port [ 644.971487] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0128e3a8-c4c6-47a3-8a1e-e89ed2797a92 with Priority: HIGHEST for action port [ 644.971487] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-0128e3a8-c4c6-47a3-8a1e-e89ed2797a92 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.971487] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0128e3a8-c4c6-47a3-8a1e-e89ed2797a92" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.971487] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0128e3a8-c4c6-47a3-8a1e-e89ed2797a92" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.972580] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0128e3a8-c4c6-47a3-8a1e-e89ed2797a92" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.973278] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0128e3a8-c4c6-47a3-8a1e-e89ed2797a92',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.054313] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.054313] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.054313] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.054313] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.054313] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.054313] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.054313] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.054313] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.054313] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.054313] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.054313] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 already deleted. [ 645.054313] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.234977] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-3 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.235468] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.235468] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.236316] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.237404] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.237404] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.237404] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.240043] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.240043] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.240545] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.240864] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 645.241078] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 645.242132] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 645.242132] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.242132] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 645.242132] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 645.262801] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 645.265030] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 645.265030] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 645.265030] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.265030] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-ca3e5c21-9407-4b0f-a878-dffb76bef40c taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.265030] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-ca3e5c21-9407-4b0f-a878-dffb76bef40c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.265030] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-ca3e5c21-9407-4b0f-a878-dffb76bef40c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.267527] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-ca3e5c21-9407-4b0f-a878-dffb76bef40c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.267527] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca3e5c21-9407-4b0f-a878-dffb76bef40c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.476026] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0128e3a8-c4c6-47a3-8a1e-e89ed2797a92 [ 645.476400] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.476670] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.476754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.477018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.477156] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.477292] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0128e3a8-c4c6-47a3-8a1e-e89ed2797a92 already deleted. [ 645.477417] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0128e3a8-c4c6-47a3-8a1e-e89ed2797a92" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.563625] env[66834]: INFO networking_nsxv3.common.synchronization [None req-b3c08e92-e0f5-4757-bf3c-4a2003d069ff None None] Enqueued Resource ID: f4c26a80-fed5-4951-b98c-af381acf7a70 with Priority: HIGHEST for action port [ 645.564179] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4c26a80-fed5-4951-b98c-af381acf7a70 with Priority: HIGHEST for action port [ 645.564499] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4c26a80-fed5-4951-b98c-af381acf7a70 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.564661] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4c26a80-fed5-4951-b98c-af381acf7a70" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.564762] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4c26a80-fed5-4951-b98c-af381acf7a70" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.565018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4c26a80-fed5-4951-b98c-af381acf7a70" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.568205] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4c26a80-fed5-4951-b98c-af381acf7a70',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.772720] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.772934] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.773069] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.774760] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.774760] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.774760] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port ca3e5c21-9407-4b0f-a878-dffb76bef40c not found, creating... [ 645.774760] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.774760] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.774760] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.774760] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.774760] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.774760] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.775319] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.775319] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.775319] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.775319] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.775440] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: ca3e5c21-9407-4b0f-a878-dffb76bef40c is going to be created. [ 645.798125] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.798377] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.798434] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.798840] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.799138] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.799385] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-ca3e5c21-9407-4b0f-a878-dffb76bef40c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.866616] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: SUCCESS [ 645.866616] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.867391] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.868053] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.868945] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.869361] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.869464] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.869793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.870202] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.870202] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.870736] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.986833] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1262896d-5f2c-4d6b-8695-adeea78ba3f6 in Status: SUCCESS [ 645.987084] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.072423] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4c26a80-fed5-4951-b98c-af381acf7a70 [ 646.072541] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.072615] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.072658] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.072935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.072935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.073104] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4c26a80-fed5-4951-b98c-af381acf7a70 already deleted. [ 646.073145] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4c26a80-fed5-4951-b98c-af381acf7a70" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.376477] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.376477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.376477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.376477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.376477] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.376477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.376477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.376477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.376477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.376477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.376477] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.376477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.376477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.376477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.376477] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.376477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.377224] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.377224] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.377224] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.377224] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.377224] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.596993] env[66834]: INFO networking_nsxv3.common.synchronization [req-b445fa43-ecd3-497a-920c-083596a31d4f req-b5ba433f-3545-4583-930e-2fcebab93556 service nova] Enqueued Resource ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 with Priority: HIGHEST for action security_group_rules [ 646.602471] env[66834]: INFO networking_nsxv3.common.synchronization [req-b445fa43-ecd3-497a-920c-083596a31d4f req-b5ba433f-3545-4583-930e-2fcebab93556 service nova] Enqueued Resource ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 with Priority: HIGHEST for action security_group_members [ 646.602471] env[66834]: INFO networking_nsxv3.common.synchronization [req-b445fa43-ecd3-497a-920c-083596a31d4f req-b5ba433f-3545-4583-930e-2fcebab93556 service nova] Enqueued Resource ID: ca3e5c21-9407-4b0f-a878-dffb76bef40c with Priority: HIGHEST for action port [ 646.602471] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 with Priority: HIGHEST for action security_group_rules [ 646.602471] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 with Priority: HIGHEST for action security_group_members [ 646.602471] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca3e5c21-9407-4b0f-a878-dffb76bef40c with Priority: HIGHEST for action port [ 646.602471] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.602471] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.602471] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.602471] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.602471] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9117e7f6-fbaa-44a8-bc92-e3fb9acd2228',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.602471] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.602471] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.602471] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.602471] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.602471] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.602471] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.604255] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.604255] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.604255] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.604255] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9117e7f6-fbaa-44a8-bc92-e3fb9acd2228',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.606354] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca3e5c21-9407-4b0f-a878-dffb76bef40c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.606354] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca3e5c21-9407-4b0f-a878-dffb76bef40c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.606354] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca3e5c21-9407-4b0f-a878-dffb76bef40c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.606354] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca3e5c21-9407-4b0f-a878-dffb76bef40c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.606354] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca3e5c21-9407-4b0f-a878-dffb76bef40c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.880873] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21deb826-26b5-4246-96bf-34da6682babd: rpc.has_security_group_logging(os_id): False [ 646.908362] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.908715] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.909100] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.909342] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.909435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.909900] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.909900] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.909900] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.910210] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.910210] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.911541] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.911541] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.911541] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.911541] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.911541] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.911541] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.911541] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.911541] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.911541] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.911541] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.911541] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21deb826-26b5-4246-96bf-34da6682babd is going to be created. [ 646.994316] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.994316] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.994316] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.994316] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.995367] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.013030] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: IN_PROGRESS for 2s [ 647.108296] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.108464] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.113511] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca3e5c21-9407-4b0f-a878-dffb76bef40c with status ACTIVE [ 647.113800] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.113972] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.114093] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.114386] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.114465] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.114677] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.114922] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.114922] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.115147] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.115147] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.115351] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.115480] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.115564] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.115691] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.115789] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.115875] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca3e5c21-9407-4b0f-a878-dffb76bef40c is going to be updated. [ 647.119893] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9117e7f6-fbaa-44a8-bc92-e3fb9acd2228',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.144623] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.144828] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.144828] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.145050] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.145192] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.145349] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca3e5c21-9407-4b0f-a878-dffb76bef40c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.184156] env[66834]: INFO networking_nsxv3.common.synchronization [req-ba100a6e-3c3d-478d-9194-42aca06d77d6 req-9b1b36d2-7a47-41e4-9f7d-74fc57eb870c tempest-SecurityGroupRulesNegativeTestJSON-1822643720 tempest-SecurityGroupRulesNegativeTestJSON-1822643720-project-member] Enqueued Resource ID: 6a07275b-99ba-4b3d-abcb-baff541878ff with Priority: HIGHEST for action security_group_rules [ 647.186090] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a07275b-99ba-4b3d-abcb-baff541878ff with Priority: HIGHEST for action security_group_rules [ 647.186090] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a07275b-99ba-4b3d-abcb-baff541878ff taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.186090] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a07275b-99ba-4b3d-abcb-baff541878ff" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.186090] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a07275b-99ba-4b3d-abcb-baff541878ff" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.186090] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a07275b-99ba-4b3d-abcb-baff541878ff" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.186347] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a07275b-99ba-4b3d-abcb-baff541878ff',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.622222] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9117e7f6-fbaa-44a8-bc92-e3fb9acd2228',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.709629] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.709788] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.709860] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.710106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.710215] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.710312] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a07275b-99ba-4b3d-abcb-baff541878ff already deleted. [ 647.710395] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a07275b-99ba-4b3d-abcb-baff541878ff" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.127293] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.127677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.127677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.127904] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.128747] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.129636] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 is going to be created. [ 648.157980] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.158188] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.158289] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.158513] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.158676] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.170827] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 in Status: UNINITIALIZED for 2s [ 649.030797] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: SUCCESS [ 649.031106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.185036] env[66834]: INFO networking_nsxv3.common.synchronization [None req-80805482-44dc-4ed8-aa1e-c385938c5795 None None] Enqueued Resource ID: db2dbaa5-28ae-49db-a173-a3d02d4a6e48 with Priority: HIGHEST for action port [ 649.185670] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db2dbaa5-28ae-49db-a173-a3d02d4a6e48 with Priority: HIGHEST for action port [ 649.185951] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-db2dbaa5-28ae-49db-a173-a3d02d4a6e48 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.186672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db2dbaa5-28ae-49db-a173-a3d02d4a6e48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.186672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db2dbaa5-28ae-49db-a173-a3d02d4a6e48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.186817] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db2dbaa5-28ae-49db-a173-a3d02d4a6e48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.186916] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db2dbaa5-28ae-49db-a173-a3d02d4a6e48',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.691516] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db2dbaa5-28ae-49db-a173-a3d02d4a6e48 [ 649.692148] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.692148] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.692148] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.692550] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.692550] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.692550] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db2dbaa5-28ae-49db-a173-a3d02d4a6e48 already deleted. [ 649.692737] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db2dbaa5-28ae-49db-a173-a3d02d4a6e48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.895282] env[66834]: INFO networking_nsxv3.common.synchronization [req-ac1afd88-6768-48fd-a740-b611a813f1ea req-c338e384-54e5-4b14-8cf4-1cbca67247e6 tempest-SecurityGroupRulesTestJSON-770145699 tempest-SecurityGroupRulesTestJSON-770145699-project-member] Enqueued Resource ID: f9b7c32a-9b1f-417e-9a2e-c5e6a0eb6bdf with Priority: HIGHEST for action security_group_rules [ 649.896166] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9b7c32a-9b1f-417e-9a2e-c5e6a0eb6bdf with Priority: HIGHEST for action security_group_rules [ 649.896253] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9b7c32a-9b1f-417e-9a2e-c5e6a0eb6bdf taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.896398] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9b7c32a-9b1f-417e-9a2e-c5e6a0eb6bdf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.896398] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9b7c32a-9b1f-417e-9a2e-c5e6a0eb6bdf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.897528] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9b7c32a-9b1f-417e-9a2e-c5e6a0eb6bdf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.897528] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9b7c32a-9b1f-417e-9a2e-c5e6a0eb6bdf',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.183439] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 in Status: SUCCESS [ 650.185289] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.185693] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.185912] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.186671] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.186671] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.186671] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.186671] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.187726] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.187726] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.187726] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9117e7f6-fbaa-44a8-bc92-e3fb9acd2228',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.237255] env[66834]: INFO networking_nsxv3.common.synchronization [req-8bc7b465-7195-47dd-b024-0828a5f51a8c req-a3adc8cd-7094-44d4-97a0-688adae7099a tempest-InstanceActionsTestJSON-2076877083 tempest-InstanceActionsTestJSON-2076877083-project-member] Enqueued Resource ID: 659c3ecb-b49f-4d7f-8978-4e0221530e96 with Priority: HIGHEST for action security_group_members [ 650.238643] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 659c3ecb-b49f-4d7f-8978-4e0221530e96 with Priority: HIGHEST for action security_group_members [ 650.239229] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-659c3ecb-b49f-4d7f-8978-4e0221530e96 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.239509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.239668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.239951] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.240210] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.240457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.240640] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.242032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.242032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.242032] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('659c3ecb-b49f-4d7f-8978-4e0221530e96',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.422552] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.422552] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.422552] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.422552] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.422552] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.422552] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9b7c32a-9b1f-417e-9a2e-c5e6a0eb6bdf already deleted. [ 650.422552] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9b7c32a-9b1f-417e-9a2e-c5e6a0eb6bdf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.693892] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9117e7f6-fbaa-44a8-bc92-e3fb9acd2228',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.743592] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.743907] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.743907] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.744234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.744352] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.744579] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.744689] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.745149] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.745149] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.745149] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.745976] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 659c3ecb-b49f-4d7f-8978-4e0221530e96 is going to be updated. [ 650.791473] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.791473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.791473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.791861] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.791861] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.807221] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 659c3ecb-b49f-4d7f-8978-4e0221530e96 in Status: IN_PROGRESS for 2s [ 651.190846] env[66834]: INFO networking_nsxv3.common.synchronization [req-90bb8a32-617b-4547-88ef-0d81eea11cb6 req-714325b4-a687-4abd-95f6-196fe62d245b tempest-SecurityGroupRulesNegativeTestJSON-1822643720 tempest-SecurityGroupRulesNegativeTestJSON-1822643720-project-member] Enqueued Resource ID: 6a07275b-99ba-4b3d-abcb-baff541878ff with Priority: HIGHEST for action security_group_rules [ 651.191411] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a07275b-99ba-4b3d-abcb-baff541878ff with Priority: HIGHEST for action security_group_rules [ 651.191764] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a07275b-99ba-4b3d-abcb-baff541878ff taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.191897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a07275b-99ba-4b3d-abcb-baff541878ff" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.191963] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a07275b-99ba-4b3d-abcb-baff541878ff" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.193590] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a07275b-99ba-4b3d-abcb-baff541878ff" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.193689] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a07275b-99ba-4b3d-abcb-baff541878ff',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.196942] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228: rpc.has_security_group_logging(os_id): False [ 651.216400] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.216595] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.216595] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.216783] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.216868] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.217122] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.217230] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.217494] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.217494] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.220008] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.220008] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 is going to be created. [ 651.286857] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.287047] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.287094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.287302] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.287485] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.303702] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 in Status: IN_PROGRESS for 2s [ 651.723574] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.723726] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.723769] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.724857] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.724986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.725125] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a07275b-99ba-4b3d-abcb-baff541878ff already deleted. [ 651.725271] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a07275b-99ba-4b3d-abcb-baff541878ff" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.819774] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 659c3ecb-b49f-4d7f-8978-4e0221530e96 in Status: SUCCESS [ 652.820135] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 659c3ecb-b49f-4d7f-8978-4e0221530e96 deletion is rescheduled due to dependency. [ 652.820285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.319043] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 in Status: SUCCESS [ 653.319294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.566507] env[66834]: INFO networking_nsxv3.common.synchronization [req-d189f505-d4eb-4cfd-bb94-d4ea5703f1f3 req-6c901abf-f5dc-44b1-825d-6fb01400b6f8 tempest-DeleteServersAdminTestJSON-46265615 tempest-DeleteServersAdminTestJSON-46265615-project-member] Enqueued Resource ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 with Priority: HIGHEST for action security_group_members [ 653.568549] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 with Priority: HIGHEST for action security_group_members [ 653.568549] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.568549] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.568549] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.568549] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.568765] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.569436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.569436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.569436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.569436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.569436] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b93eb01-51cc-4c25-b2fa-56b4a62620d3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.970418] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-582 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.970791] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.972047] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.972047] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.972047] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.972047] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.972047] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.972047] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.972435] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.972435] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 653.972547] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 653.972658] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 653.972756] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 653.972856] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 653.972952] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 653.973105] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 653.996321] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 653.996513] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 653.997683] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 653.997683] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.997683] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-3c702b78-582a-44e7-a845-831cc898dd24 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.997683] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-3c702b78-582a-44e7-a845-831cc898dd24" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.997683] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-3c702b78-582a-44e7-a845-831cc898dd24" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.998059] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-3c702b78-582a-44e7-a845-831cc898dd24" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.998961] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c702b78-582a-44e7-a845-831cc898dd24',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.075227] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.075227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.075227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.075227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.075227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.075227] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.075227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.075227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.075227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.075227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.075227] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 is going to be updated. [ 654.117029] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.117029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.117029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.117029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.117029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.126957] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 in Status: IN_PROGRESS for 2s [ 654.501870] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.502107] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.502225] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.502491] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.502631] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.502776] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 3c702b78-582a-44e7-a845-831cc898dd24 not found, creating... [ 654.503026] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.503176] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.503310] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.503487] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.503628] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.503887] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.504032] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.504187] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.504396] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.504573] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.504656] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 3c702b78-582a-44e7-a845-831cc898dd24 is going to be created. [ 654.527502] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.528826] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.528826] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.528826] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.528826] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.528826] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-3c702b78-582a-44e7-a845-831cc898dd24" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.303058] env[66834]: INFO networking_nsxv3.common.synchronization [req-d189f505-d4eb-4cfd-bb94-d4ea5703f1f3 req-23d1833e-6a91-484b-b052-5ebf6fcf8f05 service nova] Enqueued Resource ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 with Priority: HIGHEST for action security_group_rules [ 655.303058] env[66834]: INFO networking_nsxv3.common.synchronization [req-d189f505-d4eb-4cfd-bb94-d4ea5703f1f3 req-23d1833e-6a91-484b-b052-5ebf6fcf8f05 service nova] Enqueued Resource ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 with Priority: HIGHEST for action security_group_members [ 655.303461] env[66834]: INFO networking_nsxv3.common.synchronization [req-d189f505-d4eb-4cfd-bb94-d4ea5703f1f3 req-23d1833e-6a91-484b-b052-5ebf6fcf8f05 service nova] Enqueued Resource ID: 3c702b78-582a-44e7-a845-831cc898dd24 with Priority: HIGHEST for action port [ 655.305043] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 with Priority: HIGHEST for action security_group_rules [ 655.305043] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 with Priority: HIGHEST for action security_group_members [ 655.305043] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c702b78-582a-44e7-a845-831cc898dd24 with Priority: HIGHEST for action port [ 655.305043] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b93eb01-51cc-4c25-b2fa-56b4a62620d3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.305043] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.305043] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.305043] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.305043] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b93eb01-51cc-4c25-b2fa-56b4a62620d3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.306648] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.306648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.306648] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c702b78-582a-44e7-a845-831cc898dd24 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.306648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c702b78-582a-44e7-a845-831cc898dd24" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.306940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c702b78-582a-44e7-a845-831cc898dd24" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.306940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c702b78-582a-44e7-a845-831cc898dd24" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.306940] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c702b78-582a-44e7-a845-831cc898dd24',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.756550] env[66834]: INFO networking_nsxv3.common.synchronization [req-841a7661-1c40-483a-be53-ea1ddf7d28e7 req-d754bc04-a999-4e31-85ea-fd580976b072 tempest-SecurityGroupRulesTestJSON-770145699 tempest-SecurityGroupRulesTestJSON-770145699-project-member] Enqueued Resource ID: 292dacd3-159c-46b4-9465-56b34dc12f13 with Priority: HIGHEST for action security_group_rules [ 655.757039] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 292dacd3-159c-46b4-9465-56b34dc12f13 with Priority: HIGHEST for action security_group_rules [ 655.757356] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-292dacd3-159c-46b4-9465-56b34dc12f13 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.757512] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-292dacd3-159c-46b4-9465-56b34dc12f13" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.757581] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-292dacd3-159c-46b4-9465-56b34dc12f13" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.757849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-292dacd3-159c-46b4-9465-56b34dc12f13" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.757956] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('292dacd3-159c-46b4-9465-56b34dc12f13',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.810681] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.810924] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.810924] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c702b78-582a-44e7-a845-831cc898dd24 with status ACTIVE [ 655.811147] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.811379] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.811379] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.812282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.812282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.812282] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.812282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.812282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.812282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.812282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.812784] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.812784] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.812784] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.812784] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.812784] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.812784] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c702b78-582a-44e7-a845-831cc898dd24 is going to be updated. [ 655.849038] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.849038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.849038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.849038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.849401] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.849993] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c702b78-582a-44e7-a845-831cc898dd24" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.138390] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 in Status: SUCCESS [ 656.138591] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 deletion is rescheduled due to dependency. [ 656.138670] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.138824] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.139182] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.141480] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.141712] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.141712] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.141921] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.142046] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.142159] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b93eb01-51cc-4c25-b2fa-56b4a62620d3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.281490] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.281706] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.281706] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.282079] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.282079] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.282079] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 292dacd3-159c-46b4-9465-56b34dc12f13 already deleted. [ 656.282275] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-292dacd3-159c-46b4-9465-56b34dc12f13" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.330147] env[66834]: INFO networking_nsxv3.common.synchronization [None req-67f00fd3-0d1b-4130-b48c-27838ebfa3eb None None] Enqueued Resource ID: ff0c52d9-1c26-4ec7-83d7-a5c898e6ddd6 with Priority: HIGHEST for action port [ 656.330785] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff0c52d9-1c26-4ec7-83d7-a5c898e6ddd6 with Priority: HIGHEST for action port [ 656.331627] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff0c52d9-1c26-4ec7-83d7-a5c898e6ddd6 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.331759] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff0c52d9-1c26-4ec7-83d7-a5c898e6ddd6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.331831] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff0c52d9-1c26-4ec7-83d7-a5c898e6ddd6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.332171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff0c52d9-1c26-4ec7-83d7-a5c898e6ddd6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.332261] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff0c52d9-1c26-4ec7-83d7-a5c898e6ddd6',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.648391] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b93eb01-51cc-4c25-b2fa-56b4a62620d3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.835748] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff0c52d9-1c26-4ec7-83d7-a5c898e6ddd6 [ 656.835748] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.835748] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.835993] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.836058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.836152] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.836278] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff0c52d9-1c26-4ec7-83d7-a5c898e6ddd6 already deleted. [ 656.836385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff0c52d9-1c26-4ec7-83d7-a5c898e6ddd6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.056448] env[66834]: INFO networking_nsxv3.common.synchronization [req-d77afff4-8f3e-405b-aebf-d2238a312d07 req-839dad53-38b2-4a74-a738-f41704d03a5a tempest-ServerExternalEventsTest-1206431056 tempest-ServerExternalEventsTest-1206431056-project-member] Enqueued Resource ID: 1262896d-5f2c-4d6b-8695-adeea78ba3f6 with Priority: HIGHEST for action security_group_members [ 657.057066] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1262896d-5f2c-4d6b-8695-adeea78ba3f6 with Priority: HIGHEST for action security_group_members [ 657.057463] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1262896d-5f2c-4d6b-8695-adeea78ba3f6 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.057590] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.057657] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.057945] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.058130] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.058887] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.058964] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.059158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.061745] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.061891] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1262896d-5f2c-4d6b-8695-adeea78ba3f6',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.151041] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b93eb01-51cc-4c25-b2fa-56b4a62620d3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.568535] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.568535] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.568535] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.568535] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.568535] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.568535] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.568535] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.568535] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.572022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.572022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.572022] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1262896d-5f2c-4d6b-8695-adeea78ba3f6 is going to be updated. [ 657.616043] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.616249] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.617138] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.617138] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.617138] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.628746] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1262896d-5f2c-4d6b-8695-adeea78ba3f6 in Status: IN_PROGRESS for 2s [ 657.656670] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.657013] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.657013] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.657179] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.657277] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.657819] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 is going to be updated. [ 657.697837] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.697996] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.698098] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.698313] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.702690] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.735372] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 in Status: IN_PROGRESS for 2s [ 659.220295] env[66834]: INFO networking_nsxv3.common.synchronization [None req-b0bccba3-6d32-4a7a-9efe-3c6cd1048457 None None] Enqueued Resource ID: 88973f2c-302a-467e-af2c-45798bcf31df with Priority: HIGHEST for action port [ 659.222030] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88973f2c-302a-467e-af2c-45798bcf31df with Priority: HIGHEST for action port [ 659.224069] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-88973f2c-302a-467e-af2c-45798bcf31df taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.224204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88973f2c-302a-467e-af2c-45798bcf31df" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.224278] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88973f2c-302a-467e-af2c-45798bcf31df" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.224538] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88973f2c-302a-467e-af2c-45798bcf31df" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.224620] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88973f2c-302a-467e-af2c-45798bcf31df',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.517871] env[66834]: INFO networking_nsxv3.common.synchronization [None req-c759798a-bc50-4417-929a-f3820419b2d5 None None] Enqueued Resource ID: a1455c83-5efe-4f19-b1b2-ded22253e9a0 with Priority: HIGHEST for action port [ 659.518651] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1455c83-5efe-4f19-b1b2-ded22253e9a0 with Priority: HIGHEST for action port [ 659.518827] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1455c83-5efe-4f19-b1b2-ded22253e9a0 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.518930] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1455c83-5efe-4f19-b1b2-ded22253e9a0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.519010] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1455c83-5efe-4f19-b1b2-ded22253e9a0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.520417] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1455c83-5efe-4f19-b1b2-ded22253e9a0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.520748] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1455c83-5efe-4f19-b1b2-ded22253e9a0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.641031] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1262896d-5f2c-4d6b-8695-adeea78ba3f6 in Status: SUCCESS [ 659.641150] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1262896d-5f2c-4d6b-8695-adeea78ba3f6 deletion is rescheduled due to dependency. [ 659.641746] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.729030] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 88973f2c-302a-467e-af2c-45798bcf31df [ 659.729030] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.729030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.729030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.729030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.729611] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.729921] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:88973f2c-302a-467e-af2c-45798bcf31df already deleted. [ 659.730670] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88973f2c-302a-467e-af2c-45798bcf31df" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.749296] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 in Status: SUCCESS [ 659.749296] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.751066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.751066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.751066] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.751066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.751066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.751066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.751066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.751066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.751066] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b93eb01-51cc-4c25-b2fa-56b4a62620d3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.024024] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1455c83-5efe-4f19-b1b2-ded22253e9a0 [ 660.024024] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.024253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.024253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.024395] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.024479] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.024569] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1455c83-5efe-4f19-b1b2-ded22253e9a0 already deleted. [ 660.024735] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1455c83-5efe-4f19-b1b2-ded22253e9a0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.253610] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.253965] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.253965] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.254084] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.254302] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.254415] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.254415] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.254524] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.254607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.254694] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.254839] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.254933] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.254992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.255147] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.255282] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.255370] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.255426] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.255562] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.255636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.255740] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.255865] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b93eb01-51cc-4c25-b2fa-56b4a62620d3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.763350] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b93eb01-51cc-4c25-b2fa-56b4a62620d3: rpc.has_security_group_logging(os_id): False [ 660.782262] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.782465] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.782522] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.782722] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.782814] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.783052] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.783184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.783233] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.783371] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.783444] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.783635] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.783700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.783766] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.783949] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.783995] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.786774] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.786774] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.786774] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.786774] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.786774] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.786774] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 is going to be updated. [ 660.817167] env[66834]: INFO networking_nsxv3.common.synchronization [req-db596dd5-a9bc-4b89-ab1e-ff991f7ce94f req-627689f6-bfcd-46bd-b56a-0ba4a65fa869 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 with Priority: HIGHEST for action security_group_members [ 660.817167] env[66834]: INFO networking_nsxv3.common.synchronization [req-db596dd5-a9bc-4b89-ab1e-ff991f7ce94f req-627689f6-bfcd-46bd-b56a-0ba4a65fa869 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 660.817167] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 with Priority: HIGHEST for action security_group_members [ 660.817167] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 660.817605] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.817605] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.817605] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.817808] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.818177] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.818391] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.818491] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.818681] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.818767] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.818998] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c40be9d7-369b-4cf1-88e7-d822d62fa7f1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.824489] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.824797] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.824797] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.824948] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.825309] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.825423] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.825485] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.825654] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.825742] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.825846] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.860250] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.860677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.860765] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.861051] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.861225] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.882814] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 in Status: IN_PROGRESS for 2s [ 660.900594] env[66834]: INFO networking_nsxv3.common.synchronization [req-db596dd5-a9bc-4b89-ab1e-ff991f7ce94f req-627689f6-bfcd-46bd-b56a-0ba4a65fa869 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_rules [ 660.900997] env[66834]: INFO networking_nsxv3.common.synchronization [req-db596dd5-a9bc-4b89-ab1e-ff991f7ce94f req-627689f6-bfcd-46bd-b56a-0ba4a65fa869 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 660.900997] env[66834]: INFO networking_nsxv3.common.synchronization [req-db596dd5-a9bc-4b89-ab1e-ff991f7ce94f req-627689f6-bfcd-46bd-b56a-0ba4a65fa869 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 with Priority: HIGHEST for action security_group_rules [ 660.901400] env[66834]: INFO networking_nsxv3.common.synchronization [req-db596dd5-a9bc-4b89-ab1e-ff991f7ce94f req-627689f6-bfcd-46bd-b56a-0ba4a65fa869 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 with Priority: HIGHEST for action security_group_members [ 660.901400] env[66834]: INFO networking_nsxv3.common.synchronization [req-db596dd5-a9bc-4b89-ab1e-ff991f7ce94f req-627689f6-bfcd-46bd-b56a-0ba4a65fa869 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 3e3a239a-6a6f-436a-a9dc-55323b244ad8 with Priority: HIGHEST for action port [ 660.901982] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_rules [ 660.902138] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 with Priority: HIGHEST for action security_group_rules [ 660.902237] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3a239a-6a6f-436a-a9dc-55323b244ad8 with Priority: HIGHEST for action port [ 660.902329] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 660.902418] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 with Priority: HIGHEST for action security_group_members [ 660.902937] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.903120] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.903229] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.903363] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.903447] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.907530] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c40be9d7-369b-4cf1-88e7-d822d62fa7f1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.907658] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.907708] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.908058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.908262] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c40be9d7-369b-4cf1-88e7-d822d62fa7f1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.909199] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e3a239a-6a6f-436a-a9dc-55323b244ad8 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.909315] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e3a239a-6a6f-436a-a9dc-55323b244ad8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.909381] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e3a239a-6a6f-436a-a9dc-55323b244ad8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.909610] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e3a239a-6a6f-436a-a9dc-55323b244ad8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.909692] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e3a239a-6a6f-436a-a9dc-55323b244ad8',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.911982] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.912143] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.912422] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.912536] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.318122] env[66834]: INFO networking_nsxv3.common.synchronization [None req-9bcc0991-9839-4232-9a0c-8afd98817018 None None] Enqueued Resource ID: 7b76b227-5ce9-42d8-baf1-71698583d47d with Priority: HIGHEST for action port [ 661.318702] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b76b227-5ce9-42d8-baf1-71698583d47d with Priority: HIGHEST for action port [ 661.319044] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b76b227-5ce9-42d8-baf1-71698583d47d taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.319167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b76b227-5ce9-42d8-baf1-71698583d47d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.319292] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b76b227-5ce9-42d8-baf1-71698583d47d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.319477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b76b227-5ce9-42d8-baf1-71698583d47d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.319660] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b76b227-5ce9-42d8-baf1-71698583d47d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.331529] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.332286] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c40be9d7-369b-4cf1-88e7-d822d62fa7f1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.407889] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.408149] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.413673] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.413882] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.822863] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b76b227-5ce9-42d8-baf1-71698583d47d [ 661.822863] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.823150] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.823264] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.823500] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.823594] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.823693] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b76b227-5ce9-42d8-baf1-71698583d47d already deleted. [ 661.823775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b76b227-5ce9-42d8-baf1-71698583d47d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.835580] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.838066] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c40be9d7-369b-4cf1-88e7-d822d62fa7f1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.917915] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e3a239a-6a6f-436a-a9dc-55323b244ad8 with status ACTIVE [ 661.918196] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.918342] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.918413] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.918635] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.918746] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.919021] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.919136] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.919211] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.919468] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.919555] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.919807] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.919863] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.919928] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.920125] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.920245] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.920294] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e3a239a-6a6f-436a-a9dc-55323b244ad8 is going to be updated. [ 661.948039] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.948039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.948039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.948039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.948039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.948039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e3a239a-6a6f-436a-a9dc-55323b244ad8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.353604] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.353604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.353604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.353604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.353604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.353604] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21deb826-26b5-4246-96bf-34da6682babd is going to be updated. [ 662.353604] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.353604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.353604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.353604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.353604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.353604] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 is going to be created. [ 662.379066] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.379066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.379066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.379320] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.379516] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.387601] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.387601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.387601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.387601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.387601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.390383] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 in Status: UNINITIALIZED for 2s [ 662.393903] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: IN_PROGRESS for 2s [ 662.559405] env[66834]: INFO networking_nsxv3.common.synchronization [req-a9698d50-b478-427c-b186-50fa84a1dc65 req-82a233a8-657e-4937-b8a1-1818eb56b33d tempest-ServersAdminNegativeTestJSON-1367226242 tempest-ServersAdminNegativeTestJSON-1367226242-project-member] Enqueued Resource ID: 06c1d39f-c76e-47c4-9900-046863c4e37a with Priority: HIGHEST for action security_group_members [ 662.559994] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06c1d39f-c76e-47c4-9900-046863c4e37a with Priority: HIGHEST for action security_group_members [ 662.560513] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06c1d39f-c76e-47c4-9900-046863c4e37a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.560729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.560815] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.562083] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.562083] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.562083] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.562083] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.562083] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.562083] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.562083] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06c1d39f-c76e-47c4-9900-046863c4e37a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.897216] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 in Status: SUCCESS [ 662.897486] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.051533] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-582 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.051791] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.051880] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.052137] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.052758] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.052969] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.053224] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.053224] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.053224] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.053819] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 663.053819] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 663.053819] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 663.053957] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 663.054082] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 663.054151] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 663.054241] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 663.065032] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.065473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.065473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.065473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.066735] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.066735] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.066735] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.066735] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.066735] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.066735] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.066735] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06c1d39f-c76e-47c4-9900-046863c4e37a already deleted. [ 663.066735] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.081204] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 663.081204] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 663.081204] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 663.081454] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.081665] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-84cbd879-fc2c-4985-b83d-dbe82bf4b2a7 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.081836] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-84cbd879-fc2c-4985-b83d-dbe82bf4b2a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.081953] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-84cbd879-fc2c-4985-b83d-dbe82bf4b2a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.082321] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-84cbd879-fc2c-4985-b83d-dbe82bf4b2a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.082418] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84cbd879-fc2c-4985-b83d-dbe82bf4b2a7',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.586782] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.586782] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.587187] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.587380] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.587556] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.587709] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 84cbd879-fc2c-4985-b83d-dbe82bf4b2a7 not found, creating... [ 663.588016] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.588176] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.588284] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.588685] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.588863] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.589165] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.589326] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.589439] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.589725] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.589725] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.589952] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 84cbd879-fc2c-4985-b83d-dbe82bf4b2a7 is going to be created. [ 663.612424] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.612620] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.613082] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.613416] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.613916] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.614168] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-84cbd879-fc2c-4985-b83d-dbe82bf4b2a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.788142] env[66834]: INFO networking_nsxv3.common.synchronization [None req-a82edfc1-9dfd-4557-9b09-4c71b61b9281 None None] Enqueued Resource ID: 0b7fd829-2aef-4083-9e4c-58472113784b with Priority: HIGHEST for action port [ 663.788736] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b7fd829-2aef-4083-9e4c-58472113784b with Priority: HIGHEST for action port [ 663.789070] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b7fd829-2aef-4083-9e4c-58472113784b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.789226] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b7fd829-2aef-4083-9e4c-58472113784b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.789294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b7fd829-2aef-4083-9e4c-58472113784b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.789515] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b7fd829-2aef-4083-9e4c-58472113784b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.789617] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b7fd829-2aef-4083-9e4c-58472113784b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.154912] env[66834]: INFO networking_nsxv3.common.synchronization [None req-49d19630-5c26-494f-b2ae-660e4572a99a None None] Enqueued Resource ID: 4ed1eb70-f207-4233-ac8a-2186bdc30547 with Priority: HIGHEST for action port [ 664.155766] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ed1eb70-f207-4233-ac8a-2186bdc30547 with Priority: HIGHEST for action port [ 664.156069] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ed1eb70-f207-4233-ac8a-2186bdc30547 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.156069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ed1eb70-f207-4233-ac8a-2186bdc30547" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.156069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ed1eb70-f207-4233-ac8a-2186bdc30547" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.157377] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ed1eb70-f207-4233-ac8a-2186bdc30547" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.157377] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ed1eb70-f207-4233-ac8a-2186bdc30547',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.294258] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b7fd829-2aef-4083-9e4c-58472113784b [ 664.294383] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.294509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.294572] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.294800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.294860] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.295060] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b7fd829-2aef-4083-9e4c-58472113784b already deleted. [ 664.295060] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b7fd829-2aef-4083-9e4c-58472113784b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.357125] env[66834]: INFO networking_nsxv3.common.synchronization [req-a9698d50-b478-427c-b186-50fa84a1dc65 req-4130f244-6fc0-4b51-898c-d4045d008900 service nova] Enqueued Resource ID: 06c1d39f-c76e-47c4-9900-046863c4e37a with Priority: HIGHEST for action security_group_rules [ 664.357296] env[66834]: INFO networking_nsxv3.common.synchronization [req-a9698d50-b478-427c-b186-50fa84a1dc65 req-4130f244-6fc0-4b51-898c-d4045d008900 service nova] Enqueued Resource ID: 06c1d39f-c76e-47c4-9900-046863c4e37a with Priority: HIGHEST for action security_group_members [ 664.357422] env[66834]: INFO networking_nsxv3.common.synchronization [req-a9698d50-b478-427c-b186-50fa84a1dc65 req-4130f244-6fc0-4b51-898c-d4045d008900 service nova] Enqueued Resource ID: 84cbd879-fc2c-4985-b83d-dbe82bf4b2a7 with Priority: HIGHEST for action port [ 664.357685] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06c1d39f-c76e-47c4-9900-046863c4e37a with Priority: HIGHEST for action security_group_rules [ 664.357807] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06c1d39f-c76e-47c4-9900-046863c4e37a with Priority: HIGHEST for action security_group_members [ 664.357963] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84cbd879-fc2c-4985-b83d-dbe82bf4b2a7 with Priority: HIGHEST for action port [ 664.358551] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06c1d39f-c76e-47c4-9900-046863c4e37a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.359541] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.359667] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.360193] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.360543] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06c1d39f-c76e-47c4-9900-046863c4e37a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.361778] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06c1d39f-c76e-47c4-9900-046863c4e37a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.361932] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.362045] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.362261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.362624] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.362718] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.362766] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.362909] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.363370] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.363370] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06c1d39f-c76e-47c4-9900-046863c4e37a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.364738] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-84cbd879-fc2c-4985-b83d-dbe82bf4b2a7 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.364887] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84cbd879-fc2c-4985-b83d-dbe82bf4b2a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.364979] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84cbd879-fc2c-4985-b83d-dbe82bf4b2a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.365155] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84cbd879-fc2c-4985-b83d-dbe82bf4b2a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.365301] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84cbd879-fc2c-4985-b83d-dbe82bf4b2a7',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.403938] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 in Status: SUCCESS [ 664.404163] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.404369] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.404614] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.404808] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.404946] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.405032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.405232] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.405336] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.405425] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c40be9d7-369b-4cf1-88e7-d822d62fa7f1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.407069] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: SUCCESS [ 664.407905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.407905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.408307] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.408397] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.408465] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.408550] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.408680] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.408776] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.409665] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.540697] env[66834]: INFO networking_nsxv3.common.synchronization [None req-64fe3c40-839e-4698-a354-3148b6e6e327 tempest-ServerActionsTestOtherB-2089780499 tempest-ServerActionsTestOtherB-2089780499-project-member] Enqueued Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_rules [ 664.542097] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_rules [ 664.542793] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06251551-417e-4f8a-9412-fdb5036f57fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.543043] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.543221] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.543692] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.543868] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.662737] env[66834]: INFO networking_nsxv3.common.synchronization [None req-02c72d36-b523-4c90-97e2-74c2116081c6 tempest-ServerActionsTestOtherB-2089780499 tempest-ServerActionsTestOtherB-2089780499-project-member] Enqueued Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_rules [ 664.663322] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ed1eb70-f207-4233-ac8a-2186bdc30547 [ 664.663528] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.663649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.663716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.663917] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.664021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.664689] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ed1eb70-f207-4233-ac8a-2186bdc30547 already deleted. [ 664.665237] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ed1eb70-f207-4233-ac8a-2186bdc30547" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.665604] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_rules [ 664.666109] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06251551-417e-4f8a-9412-fdb5036f57fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.666496] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.775776] env[66834]: INFO networking_nsxv3.common.synchronization [req-9602f340-d115-4def-8ba6-ef80224ba5ea req-9d9cc038-5649-4ffb-b590-8e15ecc01813 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: be6a78d7-b908-447c-a3f4-0f30c644939c with Priority: HIGHEST for action security_group_members [ 664.776012] env[66834]: INFO networking_nsxv3.common.synchronization [req-9602f340-d115-4def-8ba6-ef80224ba5ea req-9d9cc038-5649-4ffb-b590-8e15ecc01813 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 with Priority: HIGHEST for action security_group_members [ 664.776161] env[66834]: INFO networking_nsxv3.common.synchronization [req-9602f340-d115-4def-8ba6-ef80224ba5ea req-9d9cc038-5649-4ffb-b590-8e15ecc01813 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 664.776745] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be6a78d7-b908-447c-a3f4-0f30c644939c with Priority: HIGHEST for action security_group_members [ 664.777636] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 with Priority: HIGHEST for action security_group_members [ 664.777730] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 664.779456] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-be6a78d7-b908-447c-a3f4-0f30c644939c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.779456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.779456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.779456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.779456] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.779456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.779456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.779456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.779456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.779456] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be6a78d7-b908-447c-a3f4-0f30c644939c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.780807] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.780807] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.780807] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.780807] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.863358] env[66834]: INFO networking_nsxv3.common.synchronization [req-9602f340-d115-4def-8ba6-ef80224ba5ea req-9d9cc038-5649-4ffb-b590-8e15ecc01813 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_rules [ 664.863538] env[66834]: INFO networking_nsxv3.common.synchronization [req-9602f340-d115-4def-8ba6-ef80224ba5ea req-9d9cc038-5649-4ffb-b590-8e15ecc01813 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 664.863693] env[66834]: INFO networking_nsxv3.common.synchronization [req-9602f340-d115-4def-8ba6-ef80224ba5ea req-9d9cc038-5649-4ffb-b590-8e15ecc01813 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: be6a78d7-b908-447c-a3f4-0f30c644939c with Priority: HIGHEST for action security_group_rules [ 664.863803] env[66834]: INFO networking_nsxv3.common.synchronization [req-9602f340-d115-4def-8ba6-ef80224ba5ea req-9d9cc038-5649-4ffb-b590-8e15ecc01813 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: be6a78d7-b908-447c-a3f4-0f30c644939c with Priority: HIGHEST for action security_group_members [ 664.863963] env[66834]: INFO networking_nsxv3.common.synchronization [req-9602f340-d115-4def-8ba6-ef80224ba5ea req-9d9cc038-5649-4ffb-b590-8e15ecc01813 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 with Priority: HIGHEST for action security_group_rules [ 664.864120] env[66834]: INFO networking_nsxv3.common.synchronization [req-9602f340-d115-4def-8ba6-ef80224ba5ea req-9d9cc038-5649-4ffb-b590-8e15ecc01813 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 with Priority: HIGHEST for action security_group_members [ 664.864248] env[66834]: INFO networking_nsxv3.common.synchronization [req-9602f340-d115-4def-8ba6-ef80224ba5ea req-9d9cc038-5649-4ffb-b590-8e15ecc01813 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 3e3a239a-6a6f-436a-a9dc-55323b244ad8 with Priority: HIGHEST for action port [ 664.864807] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_rules [ 664.864937] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be6a78d7-b908-447c-a3f4-0f30c644939c with Priority: HIGHEST for action security_group_rules [ 664.865860] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 with Priority: HIGHEST for action security_group_members [ 664.866036] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3a239a-6a6f-436a-a9dc-55323b244ad8 with Priority: HIGHEST for action port [ 664.866138] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 with Priority: HIGHEST for action security_group_rules [ 664.866243] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 664.866814] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be6a78d7-b908-447c-a3f4-0f30c644939c with Priority: HIGHEST for action security_group_members [ 664.866814] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.866814] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.867153] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be6a78d7-b908-447c-a3f4-0f30c644939c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.867153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.867153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.867749] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.867956] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be6a78d7-b908-447c-a3f4-0f30c644939c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.869064] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.869183] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.869463] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e3a239a-6a6f-436a-a9dc-55323b244ad8 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.869585] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e3a239a-6a6f-436a-a9dc-55323b244ad8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.869585] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e3a239a-6a6f-436a-a9dc-55323b244ad8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.869804] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e3a239a-6a6f-436a-a9dc-55323b244ad8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.870167] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e3a239a-6a6f-436a-a9dc-55323b244ad8',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.871257] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c40be9d7-369b-4cf1-88e7-d822d62fa7f1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.871899] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.871899] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.871899] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.872081] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-be6a78d7-b908-447c-a3f4-0f30c644939c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.872199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.872884] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06c1d39f-c76e-47c4-9900-046863c4e37a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.872998] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.873255] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06c1d39f-c76e-47c4-9900-046863c4e37a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.874277] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 84cbd879-fc2c-4985-b83d-dbe82bf4b2a7 with status ACTIVE [ 664.874449] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.874600] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.874658] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.874845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.874976] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.875121] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.875266] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.875326] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.875444] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.875554] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.875720] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.875845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.875911] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.876038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.876155] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.876275] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 84cbd879-fc2c-4985-b83d-dbe82bf4b2a7 is going to be updated. [ 664.904764] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.904764] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.904764] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.905201] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.905201] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.905284] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84cbd879-fc2c-4985-b83d-dbe82bf4b2a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.912353] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c40be9d7-369b-4cf1-88e7-d822d62fa7f1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.914843] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.076672] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.076796] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.076886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.077115] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.077209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.077303] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06251551-417e-4f8a-9412-fdb5036f57fe already deleted. [ 665.077385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.077536] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.077694] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.077780] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.284749] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('be6a78d7-b908-447c-a3f4-0f30c644939c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.373214] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e3a239a-6a6f-436a-a9dc-55323b244ad8 with status ACTIVE [ 665.373452] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.373589] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.373660] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.373881] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.373974] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.374165] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.374265] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.374330] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.374483] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.374559] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.374736] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.374829] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.374891] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.375042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.375117] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.375200] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e3a239a-6a6f-436a-a9dc-55323b244ad8 is going to be updated. [ 665.377957] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-be6a78d7-b908-447c-a3f4-0f30c644939c taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.378117] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.379205] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06c1d39f-c76e-47c4-9900-046863c4e37a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.401827] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.402058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.402184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.402500] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.402731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.403011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e3a239a-6a6f-436a-a9dc-55323b244ad8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.420952] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c40be9d7-369b-4cf1-88e7-d822d62fa7f1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.421933] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.602503] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.602655] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.602726] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.602938] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.603033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.603129] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06251551-417e-4f8a-9412-fdb5036f57fe already deleted. [ 665.603231] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.669541] env[66834]: INFO networking_nsxv3.common.synchronization [req-04f6aa9c-f263-417c-9066-5392dbecb5ab req-c556e0ff-8c7d-42eb-8aef-016f1b11c1b3 tempest-VolumesAdminNegativeTest-1905845348 tempest-VolumesAdminNegativeTest-1905845348-project-member] Enqueued Resource ID: 60ea5439-0179-41e0-a8c0-e75e739326a4 with Priority: HIGHEST for action security_group_members [ 665.670431] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60ea5439-0179-41e0-a8c0-e75e739326a4 with Priority: HIGHEST for action security_group_members [ 665.670525] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-60ea5439-0179-41e0-a8c0-e75e739326a4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.670601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.670643] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.670884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.671123] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.671653] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.671814] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.672066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.672203] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.672519] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60ea5439-0179-41e0-a8c0-e75e739326a4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.788427] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('be6a78d7-b908-447c-a3f4-0f30c644939c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.883662] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.884185] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.884185] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.884475] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.884719] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.885020] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06c1d39f-c76e-47c4-9900-046863c4e37a is going to be created. [ 665.910595] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.911015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.911304] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.911759] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.912077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.923844] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06c1d39f-c76e-47c4-9900-046863c4e37a in Status: UNINITIALIZED for 2s [ 665.924448] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.924810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.924942] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.925313] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.925401] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.925500] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 is going to be updated. [ 665.928121] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.928297] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.928481] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.928789] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.929058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.929257] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21deb826-26b5-4246-96bf-34da6682babd is going to be updated. [ 665.932212] env[66834]: INFO networking_nsxv3.common.synchronization [req-313c1ada-481c-4b79-9622-f63474d801bf req-bee1dd3b-bfe9-4c3d-bbe6-d8d1d31cb0ca tempest-SecurityGroupRulesTestJSON-770145699 tempest-SecurityGroupRulesTestJSON-770145699-project-member] Enqueued Resource ID: 02335e4b-52f9-4b1f-8752-1efa38a6d256 with Priority: HIGHEST for action security_group_rules [ 665.933332] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02335e4b-52f9-4b1f-8752-1efa38a6d256 with Priority: HIGHEST for action security_group_rules [ 665.934050] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02335e4b-52f9-4b1f-8752-1efa38a6d256 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.934204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02335e4b-52f9-4b1f-8752-1efa38a6d256" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.934204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02335e4b-52f9-4b1f-8752-1efa38a6d256" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.934571] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02335e4b-52f9-4b1f-8752-1efa38a6d256" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.934675] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02335e4b-52f9-4b1f-8752-1efa38a6d256',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.961300] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.961541] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.961585] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.962282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.962282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.963909] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.965076] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.965076] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.965076] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.965076] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.973249] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: IN_PROGRESS for 2s [ 665.974216] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 in Status: IN_PROGRESS for 2s [ 666.174971] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.175312] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.175394] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.175616] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.175711] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.175975] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.176110] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.176171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.176328] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.176405] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.176491] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60ea5439-0179-41e0-a8c0-e75e739326a4 already deleted. [ 666.176572] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.222156] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-835 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.222350] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-835" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.222520] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-835" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.222777] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-835" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.223046] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.223174] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.223277] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.223489] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.223619] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.223820] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.223925] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 666.224215] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 666.224359] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 666.224472] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.224574] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 666.224700] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 666.243200] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 666.243346] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 666.243500] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 666.243697] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-835" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.244554] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-0a467c1a-06d1-467e-8f74-d517359b5410 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.244554] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-0a467c1a-06d1-467e-8f74-d517359b5410" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.244554] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-0a467c1a-06d1-467e-8f74-d517359b5410" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.244767] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-0a467c1a-06d1-467e-8f74-d517359b5410" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.244826] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a467c1a-06d1-467e-8f74-d517359b5410',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.289584] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.289756] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.289828] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.290057] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.290153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.290252] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be6a78d7-b908-447c-a3f4-0f30c644939c is going to be created. [ 666.314980] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.314980] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.314980] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.314980] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.315308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.325604] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be6a78d7-b908-447c-a3f4-0f30c644939c in Status: UNINITIALIZED for 2s [ 666.459646] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.459840] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.459840] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.461035] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.461035] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.461035] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02335e4b-52f9-4b1f-8752-1efa38a6d256 already deleted. [ 666.461035] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02335e4b-52f9-4b1f-8752-1efa38a6d256" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.751106] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.751106] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.751106] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.751106] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.751106] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.751106] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 0a467c1a-06d1-467e-8f74-d517359b5410 not found, creating... [ 666.751106] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.751106] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.751106] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.751106] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.751106] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.751927] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.751927] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.751927] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.751927] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.751927] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.751927] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 0a467c1a-06d1-467e-8f74-d517359b5410 is going to be created. [ 666.781777] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.781777] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.781777] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.781777] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.781777] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.781777] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-0a467c1a-06d1-467e-8f74-d517359b5410" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.042935] env[66834]: INFO networking_nsxv3.common.synchronization [None req-6d53f641-2c42-4826-aba7-b376ff81fec2 None None] Enqueued Resource ID: 562c31a1-ede5-4cc5-88a6-a9f2dce87d29 with Priority: HIGHEST for action port [ 667.044021] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562c31a1-ede5-4cc5-88a6-a9f2dce87d29 with Priority: HIGHEST for action port [ 667.044021] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-562c31a1-ede5-4cc5-88a6-a9f2dce87d29 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.044021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-562c31a1-ede5-4cc5-88a6-a9f2dce87d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.044021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-562c31a1-ede5-4cc5-88a6-a9f2dce87d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.044448] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-562c31a1-ede5-4cc5-88a6-a9f2dce87d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.044557] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('562c31a1-ede5-4cc5-88a6-a9f2dce87d29',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.491434] env[66834]: INFO networking_nsxv3.common.synchronization [req-04f6aa9c-f263-417c-9066-5392dbecb5ab req-1f1e6a87-6587-4433-a62c-ff313f16fee9 service nova] Enqueued Resource ID: 60ea5439-0179-41e0-a8c0-e75e739326a4 with Priority: HIGHEST for action security_group_rules [ 667.491646] env[66834]: INFO networking_nsxv3.common.synchronization [req-04f6aa9c-f263-417c-9066-5392dbecb5ab req-1f1e6a87-6587-4433-a62c-ff313f16fee9 service nova] Enqueued Resource ID: 60ea5439-0179-41e0-a8c0-e75e739326a4 with Priority: HIGHEST for action security_group_members [ 667.491836] env[66834]: INFO networking_nsxv3.common.synchronization [req-04f6aa9c-f263-417c-9066-5392dbecb5ab req-1f1e6a87-6587-4433-a62c-ff313f16fee9 service nova] Enqueued Resource ID: 0a467c1a-06d1-467e-8f74-d517359b5410 with Priority: HIGHEST for action port [ 667.492135] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60ea5439-0179-41e0-a8c0-e75e739326a4 with Priority: HIGHEST for action security_group_rules [ 667.492265] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60ea5439-0179-41e0-a8c0-e75e739326a4 with Priority: HIGHEST for action security_group_members [ 667.492463] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a467c1a-06d1-467e-8f74-d517359b5410 with Priority: HIGHEST for action port [ 667.493167] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60ea5439-0179-41e0-a8c0-e75e739326a4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.493293] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.493382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.493632] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.493748] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60ea5439-0179-41e0-a8c0-e75e739326a4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.494850] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-60ea5439-0179-41e0-a8c0-e75e739326a4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.495966] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.496136] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.496437] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.496627] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.496786] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.496861] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.497064] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.497189] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.497305] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60ea5439-0179-41e0-a8c0-e75e739326a4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.498161] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a467c1a-06d1-467e-8f74-d517359b5410 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.499457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a467c1a-06d1-467e-8f74-d517359b5410" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.499457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a467c1a-06d1-467e-8f74-d517359b5410" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.499457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a467c1a-06d1-467e-8f74-d517359b5410" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.499457] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a467c1a-06d1-467e-8f74-d517359b5410',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.547959] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 562c31a1-ede5-4cc5-88a6-a9f2dce87d29 [ 667.548237] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.548374] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.548439] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.548647] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.548743] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.548838] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:562c31a1-ede5-4cc5-88a6-a9f2dce87d29 already deleted. [ 667.548919] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-562c31a1-ede5-4cc5-88a6-a9f2dce87d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.934926] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06c1d39f-c76e-47c4-9900-046863c4e37a in Status: SUCCESS [ 667.935295] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.935358] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.935581] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.935772] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.935936] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.936013] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.936211] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.936294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.936384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.936485] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06c1d39f-c76e-47c4-9900-046863c4e37a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.983701] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: SUCCESS [ 667.983849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.984026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.984252] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.984453] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.984610] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.984666] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.984851] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.984932] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.985036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.985164] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.986580] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 in Status: SUCCESS [ 667.986779] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.987231] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.987402] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.987586] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.987709] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.987769] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.987946] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.988032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.988242] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.988829] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.989575] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.990484] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.990484] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.990484] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.990484] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.990484] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.990484] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.990484] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c40be9d7-369b-4cf1-88e7-d822d62fa7f1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.992171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.992171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.992171] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.992171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.992333] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.992623] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.992623] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.992623] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c40be9d7-369b-4cf1-88e7-d822d62fa7f1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.000816] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60ea5439-0179-41e0-a8c0-e75e739326a4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.004041] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-60ea5439-0179-41e0-a8c0-e75e739326a4 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.004041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.004264] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a467c1a-06d1-467e-8f74-d517359b5410 with status ACTIVE [ 668.004570] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.004714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.004804] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.005060] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.005697] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.006616] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.006924] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.007011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.007205] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.007290] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.007497] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.007590] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.007629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.007789] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.007861] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.007969] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a467c1a-06d1-467e-8f74-d517359b5410 is going to be updated. [ 668.029975] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.030524] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.030641] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.031043] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.031043] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.031182] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a467c1a-06d1-467e-8f74-d517359b5410" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.180891] env[66834]: INFO networking_nsxv3.common.synchronization [req-08eea674-28ce-4065-95a9-b95b604c4d53 req-8093ac74-91b9-4011-83de-64f41e59c3ad tempest-FloatingIPsAssociationTestJSON-737304436 tempest-FloatingIPsAssociationTestJSON-737304436-project-member] Enqueued Resource ID: 01965726-b599-4a24-a0ef-beaaba998cf3 with Priority: HIGHEST for action security_group_members [ 668.181576] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01965726-b599-4a24-a0ef-beaaba998cf3 with Priority: HIGHEST for action security_group_members [ 668.181744] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-01965726-b599-4a24-a0ef-beaaba998cf3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.181906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.182076] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.182227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.182402] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.182524] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.182604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.182777] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.182905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.183971] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01965726-b599-4a24-a0ef-beaaba998cf3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.336296] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be6a78d7-b908-447c-a3f4-0f30c644939c in Status: SUCCESS [ 668.336513] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.336682] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.336908] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.337109] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.337229] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.337297] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.337487] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.337556] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.337636] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be6a78d7-b908-447c-a3f4-0f30c644939c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.440239] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06c1d39f-c76e-47c4-9900-046863c4e37a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.440725] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.440899] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.441067] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.441283] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.441420] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.441488] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.442154] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.442293] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.442398] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.442552] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06c1d39f-c76e-47c4-9900-046863c4e37a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.442674] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.442758] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.442940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.443078] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.443211] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.443283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.444645] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.444645] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.444645] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.444645] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06c1d39f-c76e-47c4-9900-046863c4e37a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.492597] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.492597] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.492597] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.494348] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c40be9d7-369b-4cf1-88e7-d822d62fa7f1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.494939] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c40be9d7-369b-4cf1-88e7-d822d62fa7f1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.505709] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60ea5439-0179-41e0-a8c0-e75e739326a4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.686484] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01965726-b599-4a24-a0ef-beaaba998cf3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.845258] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('be6a78d7-b908-447c-a3f4-0f30c644939c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.947042] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06c1d39f-c76e-47c4-9900-046863c4e37a: rpc.has_security_group_logging(os_id): False [ 668.970661] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.970854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.970854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.971104] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.971222] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.971443] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.971565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.971620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.971744] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.971838] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.971991] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.972089] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.972141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.972279] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.972345] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.972523] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.972648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.972708] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.972825] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.972892] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.972993] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06c1d39f-c76e-47c4-9900-046863c4e37a is going to be created. [ 668.996806] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.997793] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c40be9d7-369b-4cf1-88e7-d822d62fa7f1: rpc.has_security_group_logging(os_id): False [ 669.000111] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c40be9d7-369b-4cf1-88e7-d822d62fa7f1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.009352] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.009562] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.009562] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.009779] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.009974] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.009974] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60ea5439-0179-41e0-a8c0-e75e739326a4 is going to be created. [ 669.018107] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.018277] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.018349] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.018594] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.018789] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.018984] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.021183] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.021738] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.021738] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.021738] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.021738] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 is going to be created. [ 669.031307] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-153 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.031528] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-153" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.031645] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-153" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.031923] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-153" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.032202] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.032347] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.032452] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.032657] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.032794] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.032993] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.033116] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.033218] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.033520] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.033520] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.033520] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.033671] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 669.044209] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.044396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.044648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.044726] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.044937] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.059607] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.059788] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.059834] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.060080] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.060414] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.062141] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06c1d39f-c76e-47c4-9900-046863c4e37a in Status: IN_PROGRESS for 2s [ 669.068779] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 669.068779] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 669.068919] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 669.069045] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-153" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.069417] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-37eb0b3b-eb56-48cd-bd50-f3d74a2c810f taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.069659] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-37eb0b3b-eb56-48cd-bd50-f3d74a2c810f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.070034] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-37eb0b3b-eb56-48cd-bd50-f3d74a2c810f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.070210] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-37eb0b3b-eb56-48cd-bd50-f3d74a2c810f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.070834] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37eb0b3b-eb56-48cd-bd50-f3d74a2c810f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.074888] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60ea5439-0179-41e0-a8c0-e75e739326a4 in Status: UNINITIALIZED for 2s [ 669.091950] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.092183] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.092270] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.092485] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.092658] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.109685] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 in Status: IN_PROGRESS for 2s [ 669.188687] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01965726-b599-4a24-a0ef-beaaba998cf3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.213048] env[66834]: INFO networking_nsxv3.common.synchronization [None req-395dd14a-1430-466c-8e65-2a209fe3307c None None] Enqueued Resource ID: aa5851a8-c46e-4155-9cdf-f06f4630e55b with Priority: HIGHEST for action port [ 669.213048] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa5851a8-c46e-4155-9cdf-f06f4630e55b with Priority: HIGHEST for action port [ 669.213048] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa5851a8-c46e-4155-9cdf-f06f4630e55b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.213973] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa5851a8-c46e-4155-9cdf-f06f4630e55b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.213973] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa5851a8-c46e-4155-9cdf-f06f4630e55b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.213973] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa5851a8-c46e-4155-9cdf-f06f4630e55b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.213973] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa5851a8-c46e-4155-9cdf-f06f4630e55b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.348251] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('be6a78d7-b908-447c-a3f4-0f30c644939c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.504521] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.504715] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.504786] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.504964] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.505119] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.505220] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21deb826-26b5-4246-96bf-34da6682babd is going to be updated. [ 669.506452] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.506556] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.506613] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.506753] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.506830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.506914] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 is going to be updated. [ 669.536381] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.536520] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.536611] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.536900] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.537168] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.540444] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.540618] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.540683] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.540922] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.541106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.552356] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 in Status: IN_PROGRESS for 2s [ 669.553191] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: IN_PROGRESS for 2s [ 669.575954] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.575954] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.575954] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.575954] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.575954] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.575954] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 37eb0b3b-eb56-48cd-bd50-f3d74a2c810f not found, creating... [ 669.575954] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.575954] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.575954] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.575954] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.575954] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.576487] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.576487] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.576487] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.576605] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.577873] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.578155] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 37eb0b3b-eb56-48cd-bd50-f3d74a2c810f is going to be created. [ 669.598452] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.598723] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.598852] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.599211] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.599490] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.599752] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-37eb0b3b-eb56-48cd-bd50-f3d74a2c810f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.691809] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.691989] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.692071] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.692290] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.692402] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.692498] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01965726-b599-4a24-a0ef-beaaba998cf3 is going to be updated. [ 669.716508] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa5851a8-c46e-4155-9cdf-f06f4630e55b [ 669.716786] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.716907] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.716965] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.717179] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.717270] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.717366] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa5851a8-c46e-4155-9cdf-f06f4630e55b already deleted. [ 669.717439] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa5851a8-c46e-4155-9cdf-f06f4630e55b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.748482] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.748667] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.748717] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.748945] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.749082] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.761983] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01965726-b599-4a24-a0ef-beaaba998cf3 in Status: IN_PROGRESS for 2s [ 669.850874] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.851040] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.851040] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.851258] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.851510] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.851510] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be6a78d7-b908-447c-a3f4-0f30c644939c is going to be updated. [ 669.884279] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.884372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.885600] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.885600] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.885600] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.897206] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be6a78d7-b908-447c-a3f4-0f30c644939c in Status: IN_PROGRESS for 2s [ 670.325201] env[66834]: INFO networking_nsxv3.common.synchronization [req-08eea674-28ce-4065-95a9-b95b604c4d53 req-02133bb0-cf39-4c7a-a976-892cd70d0553 service nova] Enqueued Resource ID: 01965726-b599-4a24-a0ef-beaaba998cf3 with Priority: HIGHEST for action security_group_rules [ 670.329094] env[66834]: INFO networking_nsxv3.common.synchronization [req-08eea674-28ce-4065-95a9-b95b604c4d53 req-02133bb0-cf39-4c7a-a976-892cd70d0553 service nova] Enqueued Resource ID: 01965726-b599-4a24-a0ef-beaaba998cf3 with Priority: HIGHEST for action security_group_members [ 670.329094] env[66834]: INFO networking_nsxv3.common.synchronization [req-08eea674-28ce-4065-95a9-b95b604c4d53 req-02133bb0-cf39-4c7a-a976-892cd70d0553 service nova] Enqueued Resource ID: 37eb0b3b-eb56-48cd-bd50-f3d74a2c810f with Priority: HIGHEST for action port [ 670.329094] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01965726-b599-4a24-a0ef-beaaba998cf3 with Priority: HIGHEST for action security_group_rules [ 670.329094] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01965726-b599-4a24-a0ef-beaaba998cf3 with Priority: HIGHEST for action security_group_members [ 670.329094] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37eb0b3b-eb56-48cd-bd50-f3d74a2c810f with Priority: HIGHEST for action port [ 670.329094] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01965726-b599-4a24-a0ef-beaaba998cf3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.329094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.329094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.329436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.329436] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01965726-b599-4a24-a0ef-beaaba998cf3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.330297] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-01965726-b599-4a24-a0ef-beaaba998cf3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.330397] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.330533] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-37eb0b3b-eb56-48cd-bd50-f3d74a2c810f taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.330636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37eb0b3b-eb56-48cd-bd50-f3d74a2c810f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.330695] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37eb0b3b-eb56-48cd-bd50-f3d74a2c810f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.330869] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37eb0b3b-eb56-48cd-bd50-f3d74a2c810f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.330945] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37eb0b3b-eb56-48cd-bd50-f3d74a2c810f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.454957] env[66834]: INFO networking_nsxv3.common.synchronization [req-163a9d00-11b2-4f9b-8fc2-cbf837ecc4ce req-8631df31-7a31-4f29-abc3-522b38a1ebd4 tempest-ImagesOneServerNegativeTestJSON-1609959325 tempest-ImagesOneServerNegativeTestJSON-1609959325-project-member] Enqueued Resource ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 with Priority: HIGHEST for action security_group_members [ 670.455955] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 with Priority: HIGHEST for action security_group_members [ 670.455955] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.455955] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.456150] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.456529] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.456721] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.456995] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.456995] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.457182] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.457282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.457374] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.790303] env[66834]: INFO networking_nsxv3.common.synchronization [req-c9b1de53-f86f-40fa-9807-a04907d7df45 req-4fa1bb27-d664-46fd-b708-3dca07a78eca tempest-ServerDiskConfigTestJSON-362503924 tempest-ServerDiskConfigTestJSON-362503924-project-member] Enqueued Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 670.791134] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 670.791197] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.791273] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.791984] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.791984] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.791984] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.791984] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.791984] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.792307] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.792307] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.792307] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.834627] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-01965726-b599-4a24-a0ef-beaaba998cf3 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.834733] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.837530] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 37eb0b3b-eb56-48cd-bd50-f3d74a2c810f with status ACTIVE [ 670.837763] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.837909] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.838124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.839000] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.839000] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.839000] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.839000] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.839000] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.839000] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.839000] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.839591] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.839591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.839591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.839591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.839591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.839771] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 37eb0b3b-eb56-48cd-bd50-f3d74a2c810f is going to be updated. [ 670.882083] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.882083] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.882083] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.882339] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.882339] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.882873] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37eb0b3b-eb56-48cd-bd50-f3d74a2c810f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.961419] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.961685] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.961751] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.961993] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.962114] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.962353] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.962501] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.962501] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.962829] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.962999] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.962999] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 is going to be updated. [ 671.025620] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.025749] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.026733] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.026733] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.026733] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.043337] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 in Status: IN_PROGRESS for 2s [ 671.077018] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06c1d39f-c76e-47c4-9900-046863c4e37a in Status: SUCCESS [ 671.077279] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.087626] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60ea5439-0179-41e0-a8c0-e75e739326a4 in Status: SUCCESS [ 671.088067] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.088232] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.088871] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.088871] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.088871] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.089134] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.089134] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.089281] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.089318] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.089482] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60ea5439-0179-41e0-a8c0-e75e739326a4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.131537] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 in Status: SUCCESS [ 671.131727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.132323] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.132323] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.132323] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c40be9d7-369b-4cf1-88e7-d822d62fa7f1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.294366] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.294590] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.294590] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.294811] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.295049] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.295122] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.295267] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.296331] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.296331] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.296331] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.296474] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7963c125-23b5-45fd-8158-f6470d12949e already deleted. [ 671.297103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.342053] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-98 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.342053] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-98" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.342053] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-98" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.342725] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-98" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.342725] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.342725] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.342725] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.343011] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.344139] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.344438] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 671.344541] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 671.344628] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 671.344725] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 671.345036] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 671.345036] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 671.345036] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 671.366662] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 671.366662] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 671.366662] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 671.366662] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-98" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.366966] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-68c26161-014d-4a0f-945b-f18382075d59 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.366966] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-68c26161-014d-4a0f-945b-f18382075d59" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.367132] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-68c26161-014d-4a0f-945b-f18382075d59" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.367420] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-68c26161-014d-4a0f-945b-f18382075d59" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.367562] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68c26161-014d-4a0f-945b-f18382075d59',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.564900] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: SUCCESS [ 671.565114] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.565270] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.565482] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.565674] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.565792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.565848] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.566154] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.566240] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.566336] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.567762] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 in Status: SUCCESS [ 671.568179] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.568179] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.568312] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.568427] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.568530] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.568592] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.568729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.568857] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.568904] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c40be9d7-369b-4cf1-88e7-d822d62fa7f1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.592691] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-60ea5439-0179-41e0-a8c0-e75e739326a4 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.592914] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.592914] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.593158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.593345] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.593608] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.593608] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.593770] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.593770] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.593847] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.594086] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-60ea5439-0179-41e0-a8c0-e75e739326a4 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.594086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.594259] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.594259] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.594469] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.594469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.594591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.594642] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.595205] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.595205] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.595205] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60ea5439-0179-41e0-a8c0-e75e739326a4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.635947] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.637237] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.736502] env[66834]: INFO networking_nsxv3.common.synchronization [None req-a99c80bd-8352-425f-82ba-2787cf194195 tempest-ServerActionsTestOtherA-283121819 tempest-ServerActionsTestOtherA-283121819-project-member] Enqueued Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGHEST for action security_group_rules [ 671.737367] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGHEST for action security_group_rules [ 671.737733] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.737898] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.738111] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.738260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.738386] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.772150] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01965726-b599-4a24-a0ef-beaaba998cf3 in Status: SUCCESS [ 671.772569] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.772569] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.772886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.773213] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.773213] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.773213] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.773442] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.773442] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.773442] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01965726-b599-4a24-a0ef-beaaba998cf3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.870672] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.870864] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.870864] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.871253] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.871418] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.871592] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 68c26161-014d-4a0f-945b-f18382075d59 not found, creating... [ 671.872395] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.872395] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.872395] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.872893] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.872893] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.873304] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.873494] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.873655] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.873893] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.874625] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.874625] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 68c26161-014d-4a0f-945b-f18382075d59 is going to be created. [ 671.896581] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.896872] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.896965] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.897443] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.897443] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.897600] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-68c26161-014d-4a0f-945b-f18382075d59" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.907774] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be6a78d7-b908-447c-a3f4-0f30c644939c in Status: SUCCESS [ 671.908019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.908221] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.908466] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.908684] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.908827] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.908902] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.909144] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.909260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.909376] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.909489] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('be6a78d7-b908-447c-a3f4-0f30c644939c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.070520] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.071342] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c40be9d7-369b-4cf1-88e7-d822d62fa7f1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.080471] env[66834]: INFO networking_nsxv3.common.synchronization [None req-5788d80c-3b52-4903-aabc-1f13b57363bd tempest-ServerActionsTestOtherA-283121819 tempest-ServerActionsTestOtherA-283121819-project-member] Enqueued Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGHEST for action security_group_rules [ 672.080471] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGHEST for action security_group_rules [ 672.080790] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.080790] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.097594] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60ea5439-0179-41e0-a8c0-e75e739326a4: rpc.has_security_group_logging(os_id): False [ 672.117597] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.117687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.117785] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.118083] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.118205] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.118434] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.118536] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.118592] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.118761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.118837] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.119024] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.119116] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.119161] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.119302] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.119375] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.119545] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.119634] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.119692] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.119826] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.119897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.119978] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60ea5439-0179-41e0-a8c0-e75e739326a4 is going to be created. [ 672.179572] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.179775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.179827] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.179997] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.180187] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.192787] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60ea5439-0179-41e0-a8c0-e75e739326a4 in Status: IN_PROGRESS for 2s [ 672.259458] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.260104] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.260104] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.260104] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.260104] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.260104] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 already deleted. [ 672.260104] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.260398] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.260398] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.260474] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.277742] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01965726-b599-4a24-a0ef-beaaba998cf3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.412772] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('be6a78d7-b908-447c-a3f4-0f30c644939c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.573332] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.574299] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c40be9d7-369b-4cf1-88e7-d822d62fa7f1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.599692] env[66834]: INFO networking_nsxv3.common.synchronization [req-c9b1de53-f86f-40fa-9807-a04907d7df45 req-452e3997-ee03-4557-a4df-615e7eecc845 service nova] Enqueued Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_rules [ 672.599692] env[66834]: INFO networking_nsxv3.common.synchronization [req-c9b1de53-f86f-40fa-9807-a04907d7df45 req-452e3997-ee03-4557-a4df-615e7eecc845 service nova] Enqueued Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 672.599692] env[66834]: INFO networking_nsxv3.common.synchronization [req-c9b1de53-f86f-40fa-9807-a04907d7df45 req-452e3997-ee03-4557-a4df-615e7eecc845 service nova] Enqueued Resource ID: 68c26161-014d-4a0f-945b-f18382075d59 with Priority: HIGHEST for action port [ 672.600504] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_rules [ 672.600639] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 672.600733] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68c26161-014d-4a0f-945b-f18382075d59 with Priority: HIGHEST for action port [ 672.601092] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.601316] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.601420] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.601703] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.601811] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.602727] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.603046] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.603155] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.603436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.603590] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.603715] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.603810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.603976] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.604121] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.604219] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.606282] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-68c26161-014d-4a0f-945b-f18382075d59 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.607040] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68c26161-014d-4a0f-945b-f18382075d59" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.607089] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68c26161-014d-4a0f-945b-f18382075d59" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.607275] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68c26161-014d-4a0f-945b-f18382075d59" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.607482] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68c26161-014d-4a0f-945b-f18382075d59',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.779373] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01965726-b599-4a24-a0ef-beaaba998cf3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.785573] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.785787] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.785882] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.786404] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.786404] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.786404] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 already deleted. [ 672.786588] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.915625] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for be6a78d7-b908-447c-a3f4-0f30c644939c: rpc.has_security_group_logging(os_id): False [ 672.935889] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.936228] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.936228] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.936377] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.936377] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.936785] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.936785] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.936785] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.936936] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.937027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.937118] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be6a78d7-b908-447c-a3f4-0f30c644939c is going to be created. [ 672.994194] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.994556] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.994556] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.994686] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.994776] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.007605] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be6a78d7-b908-447c-a3f4-0f30c644939c in Status: IN_PROGRESS for 2s [ 673.054521] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 in Status: SUCCESS [ 673.054749] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 deletion is rescheduled due to dependency. [ 673.054830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.076846] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.076999] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.077091] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.077301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.081422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.081422] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21deb826-26b5-4246-96bf-34da6682babd is going to be updated. [ 673.081422] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.081422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.081422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.081422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.081422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.081422] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 is going to be updated. [ 673.114015] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.114015] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.114015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.114015] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68c26161-014d-4a0f-945b-f18382075d59 with status ACTIVE [ 673.114015] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.114015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.114015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.114015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.114015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.114015] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.114015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.114015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.114015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.114015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.114806] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.114806] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.114806] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.114806] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.114968] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.115680] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68c26161-014d-4a0f-945b-f18382075d59 is going to be updated. [ 673.137921] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.138188] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.138286] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.138467] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.138607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.147743] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.148020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.148020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.148267] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.149492] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.164485] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.164485] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.164485] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.164485] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.164485] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.164485] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68c26161-014d-4a0f-945b-f18382075d59" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.164485] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 in Status: IN_PROGRESS for 2s [ 673.164485] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: IN_PROGRESS for 2s [ 673.282977] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.283229] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.283287] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.283538] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.283631] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.283746] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01965726-b599-4a24-a0ef-beaaba998cf3 is going to be updated. [ 673.336635] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.336889] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.336940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.337217] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.337377] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.356406] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01965726-b599-4a24-a0ef-beaaba998cf3 in Status: IN_PROGRESS for 2s [ 673.619973] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.123450] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.124404] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.124404] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.124404] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.124404] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.124404] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7963c125-23b5-45fd-8158-f6470d12949e is going to be created. [ 674.153561] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.153770] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.153962] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.154079] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.154334] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.165575] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: UNINITIALIZED for 2s [ 674.208435] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60ea5439-0179-41e0-a8c0-e75e739326a4 in Status: SUCCESS [ 674.208635] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.671821] env[66834]: INFO networking_nsxv3.common.synchronization [req-543da3bd-8c77-4c7f-8376-52240b90a8bb req-22f36c55-5637-4002-8a79-6f42554b99eb tempest-ImagesTestJSON-910661197 tempest-ImagesTestJSON-910661197-project-member] Enqueued Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 674.674819] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 674.674819] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.674819] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.674819] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.674819] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.674819] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.674819] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.674819] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.674819] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.674819] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.675363] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.020516] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be6a78d7-b908-447c-a3f4-0f30c644939c in Status: SUCCESS [ 675.020770] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.176298] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 in Status: SUCCESS [ 675.177283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.177283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.177283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.177517] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.177723] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.178305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.178305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.178305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.178543] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.178543] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c40be9d7-369b-4cf1-88e7-d822d62fa7f1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.180775] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: SUCCESS [ 675.180965] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.181494] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.181958] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.181958] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.182164] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.182300] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.182606] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.182826] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.182889] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.183507] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.183507] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.183507] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 is going to be updated. [ 675.185901] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.185901] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.185901] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.185901] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.185901] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.185901] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.186600] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.186600] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.186600] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.186732] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.186772] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.188094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.188094] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.188094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.188094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.188094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.188094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.188094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.188608] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.220235] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.220235] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.220420] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.221030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.221030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.234233] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: IN_PROGRESS for 2s [ 675.368324] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01965726-b599-4a24-a0ef-beaaba998cf3 in Status: SUCCESS [ 675.368556] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.368713] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.368927] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.369133] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.369254] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.369313] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.369487] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.369554] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.369641] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.369732] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01965726-b599-4a24-a0ef-beaaba998cf3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.690064] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c40be9d7-369b-4cf1-88e7-d822d62fa7f1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.696878] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21deb826-26b5-4246-96bf-34da6682babd: rpc.has_security_group_logging(os_id): False [ 675.725242] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.725442] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.725566] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.726504] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.726504] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.726504] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.726504] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.726504] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.728229] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.728229] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.728229] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.728229] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.728229] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.728229] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.728229] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.728229] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.731238] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.731238] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.733976] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.733976] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.733976] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21deb826-26b5-4246-96bf-34da6682babd is going to be updated. [ 675.792555] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.792738] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.792823] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.793169] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.793262] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.809991] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: IN_PROGRESS for 2s [ 675.873073] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-01965726-b599-4a24-a0ef-beaaba998cf3 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.873392] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.873494] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.874030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.874030] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.874227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.874227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.874422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.874507] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.874636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.874820] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-01965726-b599-4a24-a0ef-beaaba998cf3 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.875126] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.875126] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.875255] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.875414] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.875568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.875670] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.875822] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.875939] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.876828] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.876980] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01965726-b599-4a24-a0ef-beaaba998cf3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.911739] env[66834]: INFO networking_nsxv3.common.synchronization [req-b3619a76-b7a8-41ba-8583-2be07d180e22 req-8a3547fc-a2ba-4fde-9704-07c8f738d79d tempest-SecurityGroupRulesTestJSON-770145699 tempest-SecurityGroupRulesTestJSON-770145699-project-member] Enqueued Resource ID: 80288e06-6e77-4c35-9df8-7aad83a410bb with Priority: HIGHEST for action security_group_rules [ 675.912801] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80288e06-6e77-4c35-9df8-7aad83a410bb with Priority: HIGHEST for action security_group_rules [ 675.913530] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80288e06-6e77-4c35-9df8-7aad83a410bb taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.913764] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80288e06-6e77-4c35-9df8-7aad83a410bb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.913954] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80288e06-6e77-4c35-9df8-7aad83a410bb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.914701] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80288e06-6e77-4c35-9df8-7aad83a410bb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.914874] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80288e06-6e77-4c35-9df8-7aad83a410bb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.178128] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: SUCCESS [ 676.178327] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.178971] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.179269] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.179472] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.181028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.181028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.181028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.181028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.181028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.181028] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.194142] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c40be9d7-369b-4cf1-88e7-d822d62fa7f1: rpc.has_security_group_logging(os_id): False [ 676.215343] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.215518] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.215588] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.215799] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.216086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.220032] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.220032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.220032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.220032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.220032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.220032] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 is going to be updated. [ 676.286383] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.286527] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.286580] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.286802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.286943] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.311064] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 in Status: IN_PROGRESS for 2s [ 676.380849] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01965726-b599-4a24-a0ef-beaaba998cf3: rpc.has_security_group_logging(os_id): False [ 676.402631] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.402631] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.402631] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.402631] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.402631] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.402937] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.403050] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.403133] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.404760] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.404760] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.404760] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.404760] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.404760] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.404760] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.404760] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.406253] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.406420] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.406507] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.407451] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.407451] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.407451] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01965726-b599-4a24-a0ef-beaaba998cf3 is going to be updated. [ 676.440575] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.440822] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.440822] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.440997] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.441105] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.441201] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80288e06-6e77-4c35-9df8-7aad83a410bb already deleted. [ 676.441286] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80288e06-6e77-4c35-9df8-7aad83a410bb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.518325] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.518521] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.518567] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.518805] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.518970] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.548966] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01965726-b599-4a24-a0ef-beaaba998cf3 in Status: IN_PROGRESS for 2s [ 676.630108] env[66834]: INFO networking_nsxv3.common.synchronization [req-019c3722-0973-480f-9f2f-2210f92bb2fc req-c84fffae-105c-4ee6-9e36-5ae45159a849 tempest-SecurityGroupRulesTestJSON-770145699 tempest-SecurityGroupRulesTestJSON-770145699-project-member] Enqueued Resource ID: 80288e06-6e77-4c35-9df8-7aad83a410bb with Priority: HIGHEST for action security_group_rules [ 676.630687] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80288e06-6e77-4c35-9df8-7aad83a410bb with Priority: HIGHEST for action security_group_rules [ 676.631152] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80288e06-6e77-4c35-9df8-7aad83a410bb taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.631620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80288e06-6e77-4c35-9df8-7aad83a410bb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.631620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80288e06-6e77-4c35-9df8-7aad83a410bb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.632483] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80288e06-6e77-4c35-9df8-7aad83a410bb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.632483] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80288e06-6e77-4c35-9df8-7aad83a410bb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.684758] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.685011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.685011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.685330] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.687775] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.687775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.687775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.687775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.687775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.687775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.687775] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.687775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.687775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.687775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.687775] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.687775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.687775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.687775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.687775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.687775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.687775] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.165087] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.165366] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.165366] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.165491] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.165588] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.165694] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80288e06-6e77-4c35-9df8-7aad83a410bb already deleted. [ 677.165789] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80288e06-6e77-4c35-9df8-7aad83a410bb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.191775] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7963c125-23b5-45fd-8158-f6470d12949e: rpc.has_security_group_logging(os_id): False [ 677.216121] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.216346] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.216446] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.216950] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.216950] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.217118] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.217473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.217473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.217610] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.217610] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.219153] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.219153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.219153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.219422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.219819] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.219819] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.220384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.220478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.220556] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.220634] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.220724] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7963c125-23b5-45fd-8158-f6470d12949e is going to be created. [ 677.245277] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: SUCCESS [ 677.245458] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 deletion is rescheduled due to dependency. [ 677.245572] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.289632] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.289632] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.289632] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.289632] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.289937] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.300588] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: IN_PROGRESS for 2s [ 677.432952] env[66834]: INFO networking_nsxv3.common.synchronization [req-8aa09cb7-4e1f-444e-8ba3-e735dcb9459e req-29cfbbf5-8eca-4fc6-be5b-a5e99c491f32 tempest-DeleteServersAdminTestJSON-46265615 tempest-DeleteServersAdminTestJSON-46265615-project-member] Enqueued Resource ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 with Priority: HIGHEST for action security_group_members [ 677.434891] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 with Priority: HIGHEST for action security_group_members [ 677.435261] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.435386] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.435466] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.435669] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.435814] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.436050] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.436175] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.436355] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.436449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.436558] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b93eb01-51cc-4c25-b2fa-56b4a62620d3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.825240] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: SUCCESS [ 677.825499] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.825694] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.825927] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.826033] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.939242] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.939455] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.939524] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.939976] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.940210] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.940485] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.940632] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.940730] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.941041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.941149] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.941250] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 is going to be updated. [ 677.973302] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.973474] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.973579] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.973893] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.974085] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.985182] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 in Status: IN_PROGRESS for 2s [ 678.326991] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 in Status: SUCCESS [ 678.328441] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.329077] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.329413] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.329603] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.330132] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.330624] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.330977] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.331165] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.331457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.331650] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.331841] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.332039] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.573097] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01965726-b599-4a24-a0ef-beaaba998cf3 in Status: SUCCESS [ 678.573340] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.834636] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.834809] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.834895] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.835117] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.835721] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.835721] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.835721] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.835721] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.835721] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.835998] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.835998] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.835998] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.836155] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.836194] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.836329] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.836418] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.836476] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.836607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.836682] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.836758] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.836845] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.315529] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: SUCCESS [ 679.315754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.341291] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21deb826-26b5-4246-96bf-34da6682babd: rpc.has_security_group_logging(os_id): False [ 679.361416] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.361604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.361604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.361757] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.361829] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.361995] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.362106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.362171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.362299] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.362393] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.362634] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.362772] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.362772] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.362924] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.363036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.363267] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.363364] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.363430] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.363556] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.363625] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.363720] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21deb826-26b5-4246-96bf-34da6682babd is going to be updated. [ 679.432722] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.432849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.432893] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.433140] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.433287] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.450639] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: IN_PROGRESS for 2s [ 679.572497] env[66834]: INFO networking_nsxv3.common.synchronization [req-2c91c530-9fc5-4aa9-8063-7463c8d8818d req-640728bd-83d8-45e7-b13a-36c56bc8b476 tempest-SecurityGroupRulesTestJSON-770145699 tempest-SecurityGroupRulesTestJSON-770145699-project-member] Enqueued Resource ID: 80288e06-6e77-4c35-9df8-7aad83a410bb with Priority: HIGHEST for action security_group_rules [ 679.574835] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80288e06-6e77-4c35-9df8-7aad83a410bb with Priority: HIGHEST for action security_group_rules [ 679.574835] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80288e06-6e77-4c35-9df8-7aad83a410bb taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.574835] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80288e06-6e77-4c35-9df8-7aad83a410bb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.574835] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80288e06-6e77-4c35-9df8-7aad83a410bb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.574835] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80288e06-6e77-4c35-9df8-7aad83a410bb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.574835] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80288e06-6e77-4c35-9df8-7aad83a410bb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.997224] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 in Status: SUCCESS [ 679.997419] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 deletion is rescheduled due to dependency. [ 679.997511] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.096536] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.097332] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.097332] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.097332] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.097332] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.097332] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80288e06-6e77-4c35-9df8-7aad83a410bb already deleted. [ 680.097332] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80288e06-6e77-4c35-9df8-7aad83a410bb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.477859] env[66834]: INFO networking_nsxv3.common.synchronization [req-82fc4f91-ffe3-473c-a63e-3d9a5d18d8a5 req-ff34b22b-4f47-4288-9375-e29e6e18994f tempest-FloatingIPsAssociationNegativeTestJSON-59745517 tempest-FloatingIPsAssociationNegativeTestJSON-59745517-project-member] Enqueued Resource ID: 2bf0f195-54b8-49b4-bd78-a433a8df0ce0 with Priority: HIGHEST for action security_group_members [ 680.478444] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bf0f195-54b8-49b4-bd78-a433a8df0ce0 with Priority: HIGHEST for action security_group_members [ 680.478755] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.478881] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.478951] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.481500] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.481642] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.481767] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.481817] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.481976] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.482070] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.482168] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bf0f195-54b8-49b4-bd78-a433a8df0ce0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.838344] env[66834]: INFO networking_nsxv3.common.synchronization [None req-3a302c0d-2a39-49a8-805e-d07aa7ae561a None None] Enqueued Resource ID: 0c1b075c-1f47-4825-8341-7c8cc1749e66 with Priority: HIGHEST for action port [ 680.838344] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c1b075c-1f47-4825-8341-7c8cc1749e66 with Priority: HIGHEST for action port [ 680.838344] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c1b075c-1f47-4825-8341-7c8cc1749e66 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.838344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c1b075c-1f47-4825-8341-7c8cc1749e66" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.838344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c1b075c-1f47-4825-8341-7c8cc1749e66" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.838344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c1b075c-1f47-4825-8341-7c8cc1749e66" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.838344] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c1b075c-1f47-4825-8341-7c8cc1749e66',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.987090] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.987894] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.988183] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.990981] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.990981] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.990981] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.991622] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.991622] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.992270] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.992270] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.992270] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bf0f195-54b8-49b4-bd78-a433a8df0ce0 is going to be updated. [ 681.034996] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.034996] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.034996] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.035465] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.035697] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.055994] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bf0f195-54b8-49b4-bd78-a433a8df0ce0 in Status: IN_PROGRESS for 2s [ 681.340716] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c1b075c-1f47-4825-8341-7c8cc1749e66 [ 681.342060] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.342060] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.342060] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.342060] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.342060] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.342060] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c1b075c-1f47-4825-8341-7c8cc1749e66 already deleted. [ 681.342060] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c1b075c-1f47-4825-8341-7c8cc1749e66" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.479332] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: SUCCESS [ 681.479850] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.702975] env[66834]: INFO networking_nsxv3.common.synchronization [req-cfa385d1-fc00-4675-b868-b62439975bad req-005bd0df-f8a6-4ab2-8831-e8e1438958d8 tempest-DeleteServersTestJSON-1250802255 tempest-DeleteServersTestJSON-1250802255-project-member] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 681.703678] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 681.703999] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.705133] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.707361] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.707361] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.708656] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.708656] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.708656] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.708656] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.708656] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.708656] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.197630] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-606 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.198955] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.198955] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.198955] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.198955] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.198955] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.198955] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.198955] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.199267] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.199439] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.199520] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.199616] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.199740] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.199801] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.199895] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.200021] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.211958] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.212810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.212810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.212810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.212810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.212810] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.212810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.212810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.213174] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.213174] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.213174] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a already deleted. [ 682.213174] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.224471] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.224471] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 682.224471] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.224824] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.224938] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-5fde2c2f-8b50-4a83-8f07-fe4323a6b9a4 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.225131] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-5fde2c2f-8b50-4a83-8f07-fe4323a6b9a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.225238] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-5fde2c2f-8b50-4a83-8f07-fe4323a6b9a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.225569] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-5fde2c2f-8b50-4a83-8f07-fe4323a6b9a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.225716] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fde2c2f-8b50-4a83-8f07-fe4323a6b9a4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.728370] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.728774] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.728867] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.729245] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.729443] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.729629] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 5fde2c2f-8b50-4a83-8f07-fe4323a6b9a4 not found, creating... [ 682.729922] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.730155] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.730294] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.730554] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.730720] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.731063] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.731225] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.731339] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.731536] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.731662] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.731791] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 5fde2c2f-8b50-4a83-8f07-fe4323a6b9a4 is going to be created. [ 682.759309] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.759602] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.759602] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.761457] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.761457] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.761457] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-5fde2c2f-8b50-4a83-8f07-fe4323a6b9a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.066812] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bf0f195-54b8-49b4-bd78-a433a8df0ce0 in Status: SUCCESS [ 683.066995] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bf0f195-54b8-49b4-bd78-a433a8df0ce0 deletion is rescheduled due to dependency. [ 683.067132] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.110696] env[66834]: INFO networking_nsxv3.common.synchronization [None req-d3ebf5d3-e369-4b53-9ad1-61e792d168bc None None] Enqueued Resource ID: 1d72c439-5ba4-48f9-94a3-48299e1665d4 with Priority: HIGHEST for action port [ 683.111193] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d72c439-5ba4-48f9-94a3-48299e1665d4 with Priority: HIGHEST for action port [ 683.111517] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d72c439-5ba4-48f9-94a3-48299e1665d4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.111646] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d72c439-5ba4-48f9-94a3-48299e1665d4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.111716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d72c439-5ba4-48f9-94a3-48299e1665d4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.111970] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d72c439-5ba4-48f9-94a3-48299e1665d4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.112068] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d72c439-5ba4-48f9-94a3-48299e1665d4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.160039] env[66834]: INFO networking_nsxv3.common.synchronization [None req-2e74c207-f4c2-4c9d-8603-03b34f8a7a65 None None] Enqueued Resource ID: d99ab732-388a-48b7-9c4c-9e46220c63e0 with Priority: HIGHEST for action port [ 683.160039] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d99ab732-388a-48b7-9c4c-9e46220c63e0 with Priority: HIGHEST for action port [ 683.160039] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-d99ab732-388a-48b7-9c4c-9e46220c63e0 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.160039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d99ab732-388a-48b7-9c4c-9e46220c63e0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.160039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d99ab732-388a-48b7-9c4c-9e46220c63e0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.160694] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d99ab732-388a-48b7-9c4c-9e46220c63e0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.161191] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d99ab732-388a-48b7-9c4c-9e46220c63e0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.583253] env[66834]: INFO networking_nsxv3.common.synchronization [req-cfa385d1-fc00-4675-b868-b62439975bad req-e4594425-976a-4674-a0f6-742ff89566dc service nova] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_rules [ 683.583253] env[66834]: INFO networking_nsxv3.common.synchronization [req-cfa385d1-fc00-4675-b868-b62439975bad req-e4594425-976a-4674-a0f6-742ff89566dc service nova] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 683.583253] env[66834]: INFO networking_nsxv3.common.synchronization [req-cfa385d1-fc00-4675-b868-b62439975bad req-e4594425-976a-4674-a0f6-742ff89566dc service nova] Enqueued Resource ID: 5fde2c2f-8b50-4a83-8f07-fe4323a6b9a4 with Priority: HIGHEST for action port [ 683.583253] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_rules [ 683.583253] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 683.583253] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fde2c2f-8b50-4a83-8f07-fe4323a6b9a4 with Priority: HIGHEST for action port [ 683.583253] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.583253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.583253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.583253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.583253] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.586883] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.586883] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.587157] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.587157] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.587333] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.587444] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.589941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.589941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.589941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.589941] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.589941] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fde2c2f-8b50-4a83-8f07-fe4323a6b9a4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.589941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fde2c2f-8b50-4a83-8f07-fe4323a6b9a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.589941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fde2c2f-8b50-4a83-8f07-fe4323a6b9a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.589941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fde2c2f-8b50-4a83-8f07-fe4323a6b9a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.589941] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fde2c2f-8b50-4a83-8f07-fe4323a6b9a4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.614161] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1d72c439-5ba4-48f9-94a3-48299e1665d4 [ 683.614287] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.614390] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.614452] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.615426] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.615426] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.615426] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1d72c439-5ba4-48f9-94a3-48299e1665d4 already deleted. [ 683.615426] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d72c439-5ba4-48f9-94a3-48299e1665d4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.666303] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d99ab732-388a-48b7-9c4c-9e46220c63e0 [ 683.666303] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.666303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.666303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.666303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.666303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.666303] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d99ab732-388a-48b7-9c4c-9e46220c63e0 already deleted. [ 683.666303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d99ab732-388a-48b7-9c4c-9e46220c63e0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.091740] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5fde2c2f-8b50-4a83-8f07-fe4323a6b9a4 with status ACTIVE [ 684.092160] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.092160] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.092303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.092418] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.092478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.092643] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.092738] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.092799] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.092928] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.093012] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.093186] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.093288] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.093345] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.093455] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.093522] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.093604] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5fde2c2f-8b50-4a83-8f07-fe4323a6b9a4 is going to be updated. [ 684.094722] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.095750] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.095874] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.120049] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.120195] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.120285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.120559] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.120697] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.120852] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fde2c2f-8b50-4a83-8f07-fe4323a6b9a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.598993] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.101142] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.101530] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.103030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.103030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.103132] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.103224] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be created. [ 685.128410] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.128526] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.128596] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.128857] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.128958] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.142287] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: UNINITIALIZED for 2s [ 685.947393] env[66834]: INFO networking_nsxv3.common.synchronization [None req-61e0dad1-cc18-463d-a721-66775ad274c4 None None] Enqueued Resource ID: 7e3bb414-12ec-4784-af6b-18b5ca72af2b with Priority: HIGHEST for action port [ 685.947393] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e3bb414-12ec-4784-af6b-18b5ca72af2b with Priority: HIGHEST for action port [ 685.947393] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e3bb414-12ec-4784-af6b-18b5ca72af2b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.948056] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e3bb414-12ec-4784-af6b-18b5ca72af2b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.948271] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e3bb414-12ec-4784-af6b-18b5ca72af2b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.950672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e3bb414-12ec-4784-af6b-18b5ca72af2b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.950672] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e3bb414-12ec-4784-af6b-18b5ca72af2b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.056924] env[66834]: INFO networking_nsxv3.common.synchronization [None req-94410afa-e5b3-4b28-8fe4-bb7f231c6b91 None None] Enqueued Resource ID: f0362ff7-e307-45ac-aa9c-4f5e006840ac with Priority: HIGHEST for action port [ 686.057620] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0362ff7-e307-45ac-aa9c-4f5e006840ac with Priority: HIGHEST for action port [ 686.057985] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0362ff7-e307-45ac-aa9c-4f5e006840ac taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.059426] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0362ff7-e307-45ac-aa9c-4f5e006840ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.059426] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0362ff7-e307-45ac-aa9c-4f5e006840ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.059426] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0362ff7-e307-45ac-aa9c-4f5e006840ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.059426] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0362ff7-e307-45ac-aa9c-4f5e006840ac',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.451620] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e3bb414-12ec-4784-af6b-18b5ca72af2b [ 686.451937] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.451937] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.452090] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.452729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.452729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.452729] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e3bb414-12ec-4784-af6b-18b5ca72af2b already deleted. [ 686.452729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e3bb414-12ec-4784-af6b-18b5ca72af2b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.562371] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f0362ff7-e307-45ac-aa9c-4f5e006840ac [ 686.562371] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.562523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.562676] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.563231] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.563231] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.563231] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f0362ff7-e307-45ac-aa9c-4f5e006840ac already deleted. [ 686.563231] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0362ff7-e307-45ac-aa9c-4f5e006840ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.730785] env[66834]: INFO networking_nsxv3.common.synchronization [req-14c1995c-f75c-4829-937d-861ee51f26d8 req-b80567c8-5cf6-48c9-a683-0c259a7e5d0e tempest-ServerAddressesTestJSON-1233461938 tempest-ServerAddressesTestJSON-1233461938-project-member] Enqueued Resource ID: 98a1f729-8e05-4426-8db7-2c883443f0e8 with Priority: HIGHEST for action security_group_members [ 686.731369] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98a1f729-8e05-4426-8db7-2c883443f0e8 with Priority: HIGHEST for action security_group_members [ 686.731672] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-98a1f729-8e05-4426-8db7-2c883443f0e8 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.731797] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.731862] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.733835] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.734039] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.734156] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.734233] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.734415] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.734502] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.734609] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98a1f729-8e05-4426-8db7-2c883443f0e8',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.154830] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: SUCCESS [ 687.154830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.154830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.154830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.154830] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.154830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.154830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.154830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.154830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.154830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.154830] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.200487] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-999 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.200786] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-999" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.200846] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-999" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.201636] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-999" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.202253] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.202253] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.202466] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.203041] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.203041] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.203041] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 687.203041] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 687.203698] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 687.203698] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 687.203698] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 687.203698] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 687.203698] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 687.231595] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 687.231901] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 687.231981] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 687.232124] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-999" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.232434] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-d22c6965-ae34-4280-babf-94a95ec45a10 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.232602] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-d22c6965-ae34-4280-babf-94a95ec45a10" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.232712] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-d22c6965-ae34-4280-babf-94a95ec45a10" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.233085] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-d22c6965-ae34-4280-babf-94a95ec45a10" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.233277] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d22c6965-ae34-4280-babf-94a95ec45a10',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.237396] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.237542] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.238293] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.238293] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.238293] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.238293] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.238293] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.238694] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.238824] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.238857] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.238921] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98a1f729-8e05-4426-8db7-2c883443f0e8 already deleted. [ 687.238999] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.490848] env[66834]: INFO networking_nsxv3.common.synchronization [None req-2f718e4d-e6c5-4ce1-9e72-f1f29260c1a9 None None] Enqueued Resource ID: 429185ff-517c-477c-9a3d-2e19594cc26c with Priority: HIGHEST for action port [ 687.492146] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 429185ff-517c-477c-9a3d-2e19594cc26c with Priority: HIGHEST for action port [ 687.492589] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-429185ff-517c-477c-9a3d-2e19594cc26c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.492854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-429185ff-517c-477c-9a3d-2e19594cc26c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.493600] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-429185ff-517c-477c-9a3d-2e19594cc26c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.493600] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-429185ff-517c-477c-9a3d-2e19594cc26c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.493600] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('429185ff-517c-477c-9a3d-2e19594cc26c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.658409] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.659620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.659620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.659620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.659620] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.659620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.659620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.659620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.659620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.659620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.659905] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.659905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.659905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.659998] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.660098] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.660369] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.660369] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.660369] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.660481] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.660554] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.660644] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.736020] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.736020] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.736207] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.737546] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.737546] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.737546] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port d22c6965-ae34-4280-babf-94a95ec45a10 not found, creating... [ 687.737546] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.737546] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.737546] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.737546] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.737546] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.737856] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.737988] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.738153] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.738384] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.738633] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.738691] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: d22c6965-ae34-4280-babf-94a95ec45a10 is going to be created. [ 687.764562] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.764810] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.764967] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.765303] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.765564] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.766285] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-d22c6965-ae34-4280-babf-94a95ec45a10" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.995390] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 429185ff-517c-477c-9a3d-2e19594cc26c [ 687.996076] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.996076] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.996076] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.996265] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.996265] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.996381] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:429185ff-517c-477c-9a3d-2e19594cc26c already deleted. [ 687.996416] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-429185ff-517c-477c-9a3d-2e19594cc26c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.164409] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a15c14c6-0aee-4e9d-b481-2661c510f44a: rpc.has_security_group_logging(os_id): False [ 688.183869] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.183869] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.183869] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.183869] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.183869] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.183869] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.183869] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.183869] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.183869] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.184222] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.184222] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.184520] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.184520] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.184650] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.184650] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.184870] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.184939] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.184966] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.185154] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.185227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.185301] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be created. [ 688.247282] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.247415] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.247490] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.247684] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.247866] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.263379] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: IN_PROGRESS for 2s [ 688.513123] env[66834]: INFO networking_nsxv3.common.synchronization [req-14c1995c-f75c-4829-937d-861ee51f26d8 req-13a527a2-6d10-4469-bf1d-11517861a656 service nova] Enqueued Resource ID: 98a1f729-8e05-4426-8db7-2c883443f0e8 with Priority: HIGHEST for action security_group_rules [ 688.513123] env[66834]: INFO networking_nsxv3.common.synchronization [req-14c1995c-f75c-4829-937d-861ee51f26d8 req-13a527a2-6d10-4469-bf1d-11517861a656 service nova] Enqueued Resource ID: 98a1f729-8e05-4426-8db7-2c883443f0e8 with Priority: HIGHEST for action security_group_members [ 688.513123] env[66834]: INFO networking_nsxv3.common.synchronization [req-14c1995c-f75c-4829-937d-861ee51f26d8 req-13a527a2-6d10-4469-bf1d-11517861a656 service nova] Enqueued Resource ID: d22c6965-ae34-4280-babf-94a95ec45a10 with Priority: HIGHEST for action port [ 688.513123] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98a1f729-8e05-4426-8db7-2c883443f0e8 with Priority: HIGHEST for action security_group_rules [ 688.513123] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98a1f729-8e05-4426-8db7-2c883443f0e8 with Priority: HIGHEST for action security_group_members [ 688.513832] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d22c6965-ae34-4280-babf-94a95ec45a10 with Priority: HIGHEST for action port [ 688.515180] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98a1f729-8e05-4426-8db7-2c883443f0e8 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.515456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.515686] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.516050] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.516378] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98a1f729-8e05-4426-8db7-2c883443f0e8',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.518878] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-98a1f729-8e05-4426-8db7-2c883443f0e8 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.518878] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.518878] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.518878] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.518878] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.519068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.520601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.520601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.520601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.520601] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98a1f729-8e05-4426-8db7-2c883443f0e8',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.524384] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-d22c6965-ae34-4280-babf-94a95ec45a10 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.524384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d22c6965-ae34-4280-babf-94a95ec45a10" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.524384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d22c6965-ae34-4280-babf-94a95ec45a10" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.524384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d22c6965-ae34-4280-babf-94a95ec45a10" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.524384] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d22c6965-ae34-4280-babf-94a95ec45a10',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.866651] env[66834]: INFO networking_nsxv3.common.synchronization [req-16c1f949-2c55-4148-8fa2-18749be36d6f req-a0d85e72-b653-4e82-adfc-3523146c9ec0 tempest-VolumesAdminNegativeTest-1905845348 tempest-VolumesAdminNegativeTest-1905845348-project-member] Enqueued Resource ID: 60ea5439-0179-41e0-a8c0-e75e739326a4 with Priority: HIGHEST for action security_group_members [ 688.866949] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60ea5439-0179-41e0-a8c0-e75e739326a4 with Priority: HIGHEST for action security_group_members [ 688.867271] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-60ea5439-0179-41e0-a8c0-e75e739326a4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.867393] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.867486] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.867653] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.867960] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.867960] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.867960] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.871318] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.871318] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.871318] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60ea5439-0179-41e0-a8c0-e75e739326a4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.015582] env[66834]: INFO networking_nsxv3.common.synchronization [None req-b360cc8f-1e2f-4c6b-bb4e-58db91c2d9e6 None None] Enqueued Resource ID: 424b6340-4e69-4383-aab8-d9a387f9c815 with Priority: HIGHEST for action port [ 689.015845] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 424b6340-4e69-4383-aab8-d9a387f9c815 with Priority: HIGHEST for action port [ 689.016608] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-424b6340-4e69-4383-aab8-d9a387f9c815 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.016608] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-424b6340-4e69-4383-aab8-d9a387f9c815" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.016849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-424b6340-4e69-4383-aab8-d9a387f9c815" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.017026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-424b6340-4e69-4383-aab8-d9a387f9c815" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.017113] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('424b6340-4e69-4383-aab8-d9a387f9c815',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.027090] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-98a1f729-8e05-4426-8db7-2c883443f0e8 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.027090] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.027090] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98a1f729-8e05-4426-8db7-2c883443f0e8',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.030493] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d22c6965-ae34-4280-babf-94a95ec45a10 with status ACTIVE [ 689.032068] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.032068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.032068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.032068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.032068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.032068] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.032068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.032068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.032068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.032068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.032400] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.032439] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.032927] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.032927] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.032927] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.033106] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d22c6965-ae34-4280-babf-94a95ec45a10 is going to be updated. [ 689.054167] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.054285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.054339] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.054545] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.054684] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.054849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d22c6965-ae34-4280-babf-94a95ec45a10" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.374636] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.374636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.374636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.374636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.374636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.374636] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.374636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.374636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.374636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.375086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.375086] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60ea5439-0179-41e0-a8c0-e75e739326a4 is going to be updated. [ 689.406713] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.406867] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.406912] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.408807] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.408807] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.418084] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60ea5439-0179-41e0-a8c0-e75e739326a4 in Status: IN_PROGRESS for 2s [ 689.521691] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 424b6340-4e69-4383-aab8-d9a387f9c815 [ 689.522141] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.522141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.522141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.522251] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.522280] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.522382] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:424b6340-4e69-4383-aab8-d9a387f9c815 already deleted. [ 689.522462] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-424b6340-4e69-4383-aab8-d9a387f9c815" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.534663] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98a1f729-8e05-4426-8db7-2c883443f0e8',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.979567] env[66834]: INFO networking_nsxv3.common.synchronization [None req-13bd06f0-453a-4f42-b40e-91323d9d6444 None None] Enqueued Resource ID: 326b0265-fa28-4491-a89a-3276c1470faa with Priority: HIGHEST for action port [ 689.980346] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326b0265-fa28-4491-a89a-3276c1470faa with Priority: HIGHEST for action port [ 689.980701] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-326b0265-fa28-4491-a89a-3276c1470faa taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.983731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-326b0265-fa28-4491-a89a-3276c1470faa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.983731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-326b0265-fa28-4491-a89a-3276c1470faa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.983731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-326b0265-fa28-4491-a89a-3276c1470faa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.983731] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('326b0265-fa28-4491-a89a-3276c1470faa',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.040176] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.040350] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.041662] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.041662] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.041662] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.041662] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98a1f729-8e05-4426-8db7-2c883443f0e8 is going to be created. [ 690.066042] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.066042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.066042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.066042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.066042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.075387] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98a1f729-8e05-4426-8db7-2c883443f0e8 in Status: UNINITIALIZED for 2s [ 690.279025] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: SUCCESS [ 690.279025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.485362] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 326b0265-fa28-4491-a89a-3276c1470faa [ 690.485362] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.485547] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.486066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.486537] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.486612] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.486681] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:326b0265-fa28-4491-a89a-3276c1470faa already deleted. [ 690.486764] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-326b0265-fa28-4491-a89a-3276c1470faa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.584048] env[66834]: INFO networking_nsxv3.common.synchronization [req-4fcdca15-7153-4e73-81ac-dc612df32fa3 req-23a38a54-1359-4e40-822b-a7b2ff361d1b tempest-ServerActionsTestOtherB-2089780499 tempest-ServerActionsTestOtherB-2089780499-project-member] Enqueued Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_members [ 690.584421] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_members [ 690.584642] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06251551-417e-4f8a-9412-fdb5036f57fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.584852] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.584852] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.585142] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.585300] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.585490] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.585564] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.585729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.585820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.585926] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.036655] env[66834]: INFO networking_nsxv3.common.synchronization [None req-2f4c0093-e790-4a60-972b-1c3c060afe41 None None] Enqueued Resource ID: 58c0eeae-f30d-4e83-a92d-775a0a353f37 with Priority: HIGHEST for action port [ 691.038029] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58c0eeae-f30d-4e83-a92d-775a0a353f37 with Priority: HIGHEST for action port [ 691.038029] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-58c0eeae-f30d-4e83-a92d-775a0a353f37 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.038029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58c0eeae-f30d-4e83-a92d-775a0a353f37" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.038478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58c0eeae-f30d-4e83-a92d-775a0a353f37" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.039411] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58c0eeae-f30d-4e83-a92d-775a0a353f37" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.039496] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58c0eeae-f30d-4e83-a92d-775a0a353f37',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.087746] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.087912] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.087987] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.088325] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.088420] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.088706] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.088812] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.089411] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.089411] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.089411] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.089411] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06251551-417e-4f8a-9412-fdb5036f57fe already deleted. [ 691.089411] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.118070] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.118281] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-608" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.118409] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-608" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.118716] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-608" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.119137] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.119476] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.119617] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.119867] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.120018] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.120287] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.120428] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 691.120545] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 691.120707] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 691.120874] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.121415] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 691.121793] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 691.150443] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 691.150613] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 691.150751] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 691.150937] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-608" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.151275] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-51942501-1ce2-4811-b086-37e11408afb2 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.151452] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-51942501-1ce2-4811-b086-37e11408afb2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.151565] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-51942501-1ce2-4811-b086-37e11408afb2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.151876] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-51942501-1ce2-4811-b086-37e11408afb2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.152034] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51942501-1ce2-4811-b086-37e11408afb2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.431128] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60ea5439-0179-41e0-a8c0-e75e739326a4 in Status: SUCCESS [ 691.431298] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60ea5439-0179-41e0-a8c0-e75e739326a4 deletion is rescheduled due to dependency. [ 691.431412] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.544494] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58c0eeae-f30d-4e83-a92d-775a0a353f37 [ 691.544811] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.545017] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.545090] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.545309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.545446] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.545552] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58c0eeae-f30d-4e83-a92d-775a0a353f37 already deleted. [ 691.545642] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58c0eeae-f30d-4e83-a92d-775a0a353f37" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.655561] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.657990] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.657990] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.657990] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.657990] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.657990] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 51942501-1ce2-4811-b086-37e11408afb2 not found, creating... [ 691.657990] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.657990] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.657990] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.657990] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.657990] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.658542] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.658542] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.658542] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.660023] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.660198] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.660428] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 51942501-1ce2-4811-b086-37e11408afb2 is going to be created. [ 691.684332] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.684332] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.684332] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.684332] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.684332] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.684912] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-51942501-1ce2-4811-b086-37e11408afb2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.087271] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98a1f729-8e05-4426-8db7-2c883443f0e8 in Status: SUCCESS [ 692.087481] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.087650] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.087867] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.088093] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.088258] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.088330] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.088507] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.088588] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.088687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.088759] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('98a1f729-8e05-4426-8db7-2c883443f0e8',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.431741] env[66834]: INFO networking_nsxv3.common.synchronization [req-4fcdca15-7153-4e73-81ac-dc612df32fa3 req-e3544a6e-141f-49e1-918a-bce3e0186796 service nova] Enqueued Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_rules [ 692.431910] env[66834]: INFO networking_nsxv3.common.synchronization [req-4fcdca15-7153-4e73-81ac-dc612df32fa3 req-e3544a6e-141f-49e1-918a-bce3e0186796 service nova] Enqueued Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_members [ 692.432050] env[66834]: INFO networking_nsxv3.common.synchronization [req-4fcdca15-7153-4e73-81ac-dc612df32fa3 req-e3544a6e-141f-49e1-918a-bce3e0186796 service nova] Enqueued Resource ID: 51942501-1ce2-4811-b086-37e11408afb2 with Priority: HIGHEST for action port [ 692.432284] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_rules [ 692.432410] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_members [ 692.432510] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51942501-1ce2-4811-b086-37e11408afb2 with Priority: HIGHEST for action port [ 692.433221] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06251551-417e-4f8a-9412-fdb5036f57fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.433417] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.433417] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.433606] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.433681] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.434664] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06251551-417e-4f8a-9412-fdb5036f57fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.434795] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.434855] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.435043] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.435255] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.435362] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.435440] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.435686] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.435686] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.435784] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.436989] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-51942501-1ce2-4811-b086-37e11408afb2 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.436989] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51942501-1ce2-4811-b086-37e11408afb2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.436989] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51942501-1ce2-4811-b086-37e11408afb2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.436989] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51942501-1ce2-4811-b086-37e11408afb2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.437384] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51942501-1ce2-4811-b086-37e11408afb2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.562968] env[66834]: INFO networking_nsxv3.common.synchronization [None req-e724b089-4c8a-4f69-b8da-e10421926d3f tempest-ServersTestFqdnHostnames-454654824 tempest-ServersTestFqdnHostnames-454654824-project-member] Enqueued Resource ID: 3db0e155-352c-4d42-a24e-48fff17d86ac with Priority: HIGHEST for action security_group_rules [ 692.563436] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3db0e155-352c-4d42-a24e-48fff17d86ac with Priority: HIGHEST for action security_group_rules [ 692.563756] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3db0e155-352c-4d42-a24e-48fff17d86ac taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.563878] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.563956] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.564279] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.564365] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3db0e155-352c-4d42-a24e-48fff17d86ac',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.590983] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-98a1f729-8e05-4426-8db7-2c883443f0e8 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.591224] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.591344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.591663] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.591916] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.592332] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.592461] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.592694] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.592827] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.592969] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.593420] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-98a1f729-8e05-4426-8db7-2c883443f0e8 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.593571] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.593676] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.594144] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.594384] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.594543] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.594659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.595110] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.595294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.595449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.599020] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('98a1f729-8e05-4426-8db7-2c883443f0e8',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.832492] env[66834]: INFO networking_nsxv3.common.synchronization [None req-d6c4b1dc-2934-4d16-832c-09bdf39b7697 tempest-ServersTestFqdnHostnames-454654824 tempest-ServersTestFqdnHostnames-454654824-project-member] Enqueued Resource ID: 3db0e155-352c-4d42-a24e-48fff17d86ac with Priority: HIGHEST for action security_group_rules [ 692.834160] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3db0e155-352c-4d42-a24e-48fff17d86ac with Priority: HIGHEST for action security_group_rules [ 692.834548] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3db0e155-352c-4d42-a24e-48fff17d86ac taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.834901] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.942234] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06251551-417e-4f8a-9412-fdb5036f57fe taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.942234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.942234] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.942234] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51942501-1ce2-4811-b086-37e11408afb2 with status ACTIVE [ 692.942234] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.942234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.942234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.942234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.942234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.942234] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.942234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.942234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.942839] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.943039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.943362] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.943590] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.943756] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.943991] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.944264] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.944572] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51942501-1ce2-4811-b086-37e11408afb2 is going to be updated. [ 692.972340] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.972340] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.972340] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.972340] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.972340] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.972340] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51942501-1ce2-4811-b086-37e11408afb2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.001319] env[66834]: INFO networking_nsxv3.common.synchronization [None req-064f819f-8a81-4fc6-8588-2de2aa638755 tempest-ImagesOneServerNegativeTestJSON-1609959325 tempest-ImagesOneServerNegativeTestJSON-1609959325-project-member] Enqueued Resource ID: ed3f8553-148f-46ef-86c3-686b4a1c404e with Priority: HIGHEST for action security_group_rules [ 693.001319] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed3f8553-148f-46ef-86c3-686b4a1c404e with Priority: HIGHEST for action security_group_rules [ 693.001319] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed3f8553-148f-46ef-86c3-686b4a1c404e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.001319] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed3f8553-148f-46ef-86c3-686b4a1c404e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.001319] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed3f8553-148f-46ef-86c3-686b4a1c404e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.001319] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed3f8553-148f-46ef-86c3-686b4a1c404e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.001319] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed3f8553-148f-46ef-86c3-686b4a1c404e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.088898] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.089146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.089146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.089364] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.089416] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.089510] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3db0e155-352c-4d42-a24e-48fff17d86ac already deleted. [ 693.090700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.090700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.090700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.090700] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3db0e155-352c-4d42-a24e-48fff17d86ac',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.098796] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 98a1f729-8e05-4426-8db7-2c883443f0e8: rpc.has_security_group_logging(os_id): False [ 693.120567] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.120567] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.120567] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.120751] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.120751] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.121857] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.121857] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.121857] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.121857] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.121857] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.121857] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.121857] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.121857] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.121857] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.122209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.122241] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.122352] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.122392] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.122517] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.122588] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.122667] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98a1f729-8e05-4426-8db7-2c883443f0e8 is going to be created. [ 693.187708] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.187820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.187938] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.188246] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.188429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.195694] env[66834]: INFO networking_nsxv3.common.synchronization [None req-2b0a92a5-2ccd-4530-9d3e-aea9c68c883f None None] Enqueued Resource ID: eb20162d-ae6b-477f-952d-53a3103804fd with Priority: HIGHEST for action port [ 693.196375] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb20162d-ae6b-477f-952d-53a3103804fd with Priority: HIGHEST for action port [ 693.196615] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb20162d-ae6b-477f-952d-53a3103804fd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.196738] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb20162d-ae6b-477f-952d-53a3103804fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.196803] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb20162d-ae6b-477f-952d-53a3103804fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.197282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb20162d-ae6b-477f-952d-53a3103804fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.197378] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb20162d-ae6b-477f-952d-53a3103804fd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.202039] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98a1f729-8e05-4426-8db7-2c883443f0e8 in Status: IN_PROGRESS for 2s [ 693.446989] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.521926] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.522071] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.522140] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.522334] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.522416] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.522502] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed3f8553-148f-46ef-86c3-686b4a1c404e already deleted. [ 693.522581] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed3f8553-148f-46ef-86c3-686b4a1c404e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.577097] env[66834]: INFO networking_nsxv3.common.synchronization [None req-dfcfbe92-d2c4-4aaa-94ee-a7b43f0e9104 tempest-ImagesOneServerNegativeTestJSON-1609959325 tempest-ImagesOneServerNegativeTestJSON-1609959325-project-member] Enqueued Resource ID: ed3f8553-148f-46ef-86c3-686b4a1c404e with Priority: HIGHEST for action security_group_rules [ 693.577613] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed3f8553-148f-46ef-86c3-686b4a1c404e with Priority: HIGHEST for action security_group_rules [ 693.577926] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed3f8553-148f-46ef-86c3-686b4a1c404e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.578042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed3f8553-148f-46ef-86c3-686b4a1c404e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.578110] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed3f8553-148f-46ef-86c3-686b4a1c404e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.578347] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed3f8553-148f-46ef-86c3-686b4a1c404e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.578420] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed3f8553-148f-46ef-86c3-686b4a1c404e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.615071] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.615311] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.615311] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.615492] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.615666] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.615732] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3db0e155-352c-4d42-a24e-48fff17d86ac already deleted. [ 693.615808] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.699519] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb20162d-ae6b-477f-952d-53a3103804fd [ 693.699759] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.699884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.699957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.700189] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.700280] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.700391] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb20162d-ae6b-477f-952d-53a3103804fd already deleted. [ 693.700461] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb20162d-ae6b-477f-952d-53a3103804fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.952545] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.952830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.952830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.953562] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.953562] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.953562] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06251551-417e-4f8a-9412-fdb5036f57fe is going to be created. [ 693.981096] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.981663] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.981741] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.982210] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.982402] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.001374] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: UNINITIALIZED for 2s [ 694.101805] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.101805] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.101805] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.101805] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.101805] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.101805] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed3f8553-148f-46ef-86c3-686b4a1c404e already deleted. [ 694.101805] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed3f8553-148f-46ef-86c3-686b4a1c404e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.215205] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98a1f729-8e05-4426-8db7-2c883443f0e8 in Status: SUCCESS [ 695.215205] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.518264] env[66834]: INFO networking_nsxv3.common.synchronization [None req-c4684250-590b-4875-aa85-091dc57b696d tempest-ServersTestManualDisk-242123046 tempest-ServersTestManualDisk-242123046-project-member] Enqueued Resource ID: b11bc7eb-c1bb-49d4-8347-38576752a094 with Priority: HIGHEST for action security_group_rules [ 695.519152] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b11bc7eb-c1bb-49d4-8347-38576752a094 with Priority: HIGHEST for action security_group_rules [ 695.519566] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b11bc7eb-c1bb-49d4-8347-38576752a094 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.519713] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.519713] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.519987] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.520155] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b11bc7eb-c1bb-49d4-8347-38576752a094',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.611885] env[66834]: INFO networking_nsxv3.common.synchronization [None req-395f9190-ec96-4f8d-bf9d-e5331c941daa tempest-ServersTestManualDisk-242123046 tempest-ServersTestManualDisk-242123046-project-member] Enqueued Resource ID: b11bc7eb-c1bb-49d4-8347-38576752a094 with Priority: HIGHEST for action security_group_rules [ 695.612449] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b11bc7eb-c1bb-49d4-8347-38576752a094 with Priority: HIGHEST for action security_group_rules [ 695.612856] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b11bc7eb-c1bb-49d4-8347-38576752a094 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.612955] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.013709] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: SUCCESS [ 696.014172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.014276] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.014532] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.014786] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.014989] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.015103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.015311] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.015756] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.015893] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.016053] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.048942] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.048942] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.048942] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.049212] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.049565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.049565] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b11bc7eb-c1bb-49d4-8347-38576752a094 already deleted. [ 696.049565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.049642] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.049909] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.049909] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b11bc7eb-c1bb-49d4-8347-38576752a094',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.519209] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.572085] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.572281] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.572430] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.572531] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.572652] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.572798] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b11bc7eb-c1bb-49d4-8347-38576752a094 already deleted. [ 696.572798] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.026863] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06251551-417e-4f8a-9412-fdb5036f57fe: rpc.has_security_group_logging(os_id): False [ 697.054305] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.054463] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.054509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.056107] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.056107] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.056107] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.056107] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.056107] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.056107] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.056107] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.056107] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06251551-417e-4f8a-9412-fdb5036f57fe is going to be created. [ 697.124668] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.125132] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.125132] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.125132] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.125594] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.140599] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: IN_PROGRESS for 2s [ 699.161480] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: SUCCESS [ 699.161480] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.592146] env[66834]: INFO networking_nsxv3.common.synchronization [req-c99749d1-7cc7-4dd7-958d-54b1bb32f508 req-93db144a-474c-4c70-a05c-b7784b126546 tempest-DeleteServersTestJSON-1250802255 tempest-DeleteServersTestJSON-1250802255-project-member] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 699.592146] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 699.592146] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.592146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.592146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.592146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.592146] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.592639] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.592806] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.593110] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.593288] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.593494] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.095850] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.095992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.096072] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.096303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.096471] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.096596] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.096692] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.096820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.096908] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.096985] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.097085] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be updated. [ 700.142317] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.142468] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.142537] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.142746] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.144480] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.156085] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: IN_PROGRESS for 2s [ 701.533478] env[66834]: INFO networking_nsxv3.common.synchronization [req-21f86c7a-f4ba-4cb9-8836-30fa6a592372 req-c02ae15e-e61b-4544-8ff1-15d4ac0224f5 tempest-ImagesTestJSON-910661197 tempest-ImagesTestJSON-910661197-project-member] Enqueued Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 701.534194] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 701.534583] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.534746] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.534843] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.535128] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.535338] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.535474] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.535566] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.535780] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.535900] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.536045] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.954186] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-793 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.954388] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-793" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.954549] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-793" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.954881] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-793" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.955105] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.955263] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.955399] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.955615] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.955752] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.956030] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 701.957655] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 701.959328] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 701.959328] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 701.959328] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 701.959328] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 701.959328] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 701.981796] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 701.981989] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 701.982169] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 701.982318] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-793" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.982855] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-4e40265f-b20e-4f55-8338-b63d36441b20 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.983123] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-4e40265f-b20e-4f55-8338-b63d36441b20" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.983218] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-4e40265f-b20e-4f55-8338-b63d36441b20" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.983542] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-4e40265f-b20e-4f55-8338-b63d36441b20" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.983695] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e40265f-b20e-4f55-8338-b63d36441b20',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.038808] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.038979] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.039063] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.039277] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.039375] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.039604] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.039708] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.039772] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.039927] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.040011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.040721] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 is going to be updated. [ 702.070026] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.070181] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.070246] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.070460] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.070898] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.080721] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: IN_PROGRESS for 2s [ 702.168679] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: SUCCESS [ 702.168867] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a deletion is rescheduled due to dependency. [ 702.168985] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.487723] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.487997] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.488137] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.488473] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.488644] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.488806] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 4e40265f-b20e-4f55-8338-b63d36441b20 not found, creating... [ 702.489094] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.489256] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.489413] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.489659] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.489811] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.490966] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.491216] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.491370] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.491577] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.491724] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.491865] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 4e40265f-b20e-4f55-8338-b63d36441b20 is going to be created. [ 702.517993] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.518295] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.518412] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.518720] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.518942] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.519224] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-4e40265f-b20e-4f55-8338-b63d36441b20" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.651370] env[66834]: INFO networking_nsxv3.common.synchronization [req-2d6f8862-b0ff-49f5-9803-d45157becdd6 req-b154d10b-975a-4143-8e65-8e3cb947eea4 tempest-FloatingIPsAssociationTestJSON-737304436 tempest-FloatingIPsAssociationTestJSON-737304436-project-member] Enqueued Resource ID: 01965726-b599-4a24-a0ef-beaaba998cf3 with Priority: HIGHEST for action security_group_members [ 702.652251] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01965726-b599-4a24-a0ef-beaaba998cf3 with Priority: HIGHEST for action security_group_members [ 702.652580] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-01965726-b599-4a24-a0ef-beaaba998cf3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.652749] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.652856] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.653136] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.653326] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.653480] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.653585] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.653777] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.653896] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.653998] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01965726-b599-4a24-a0ef-beaaba998cf3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.156393] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01965726-b599-4a24-a0ef-beaaba998cf3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.247023] env[66834]: INFO networking_nsxv3.common.synchronization [req-21f86c7a-f4ba-4cb9-8836-30fa6a592372 req-beafef08-76a6-40d5-b8a4-a592e4839c7c service nova] Enqueued Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_rules [ 703.247023] env[66834]: INFO networking_nsxv3.common.synchronization [req-21f86c7a-f4ba-4cb9-8836-30fa6a592372 req-beafef08-76a6-40d5-b8a4-a592e4839c7c service nova] Enqueued Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 703.247023] env[66834]: INFO networking_nsxv3.common.synchronization [req-21f86c7a-f4ba-4cb9-8836-30fa6a592372 req-beafef08-76a6-40d5-b8a4-a592e4839c7c service nova] Enqueued Resource ID: 4e40265f-b20e-4f55-8338-b63d36441b20 with Priority: HIGHEST for action port [ 703.247023] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_rules [ 703.247023] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 703.247023] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e40265f-b20e-4f55-8338-b63d36441b20 with Priority: HIGHEST for action port [ 703.247023] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.247023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.247023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.247599] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.247792] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.248843] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.249270] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.250129] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e40265f-b20e-4f55-8338-b63d36441b20 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.250242] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e40265f-b20e-4f55-8338-b63d36441b20" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.250307] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e40265f-b20e-4f55-8338-b63d36441b20" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.250501] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e40265f-b20e-4f55-8338-b63d36441b20" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.250578] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e40265f-b20e-4f55-8338-b63d36441b20',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.658436] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01965726-b599-4a24-a0ef-beaaba998cf3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.752484] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.752618] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.752796] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e40265f-b20e-4f55-8338-b63d36441b20 with status ACTIVE [ 703.752958] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.753085] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.753143] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.753434] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.753434] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.753692] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.753777] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.753777] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.753911] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.753987] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.754180] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.754274] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.754334] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.754504] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.754600] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.754682] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e40265f-b20e-4f55-8338-b63d36441b20 is going to be updated. [ 703.777920] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.778152] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.778221] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.778518] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.778579] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.778740] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e40265f-b20e-4f55-8338-b63d36441b20" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.091883] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: SUCCESS [ 704.092161] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 deletion is rescheduled due to dependency. [ 704.092318] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.093354] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.093354] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.093354] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.093354] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.093354] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.093573] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.093601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.093747] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.161289] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.162143] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.162143] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.162143] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.162143] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.162143] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01965726-b599-4a24-a0ef-beaaba998cf3 is going to be updated. [ 704.192931] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.193126] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.193184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.193455] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.193604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.203202] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01965726-b599-4a24-a0ef-beaaba998cf3 in Status: IN_PROGRESS for 2s [ 704.243491] env[66834]: INFO networking_nsxv3.common.synchronization [req-7d83b6e5-9b56-4ae9-828d-12c2b06f1551 req-b331a988-6017-4bff-9142-3bbedad0e667 tempest-ServerActionsTestOtherA-283121819 tempest-ServerActionsTestOtherA-283121819-project-member] Enqueued Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGHEST for action security_group_members [ 704.244522] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGHEST for action security_group_members [ 704.244935] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.246047] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.246251] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.248949] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.249230] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.249417] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.249493] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.249764] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.249863] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.250015] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.597307] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.660043] env[66834]: INFO networking_nsxv3.common.synchronization [None req-0d30c385-1241-4684-be2f-0c64d839a738 None None] Enqueued Resource ID: 41681a5f-946c-46cf-9286-971cc0880a50 with Priority: HIGHEST for action port [ 704.660640] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41681a5f-946c-46cf-9286-971cc0880a50 with Priority: HIGHEST for action port [ 704.660942] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-41681a5f-946c-46cf-9286-971cc0880a50 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.661077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41681a5f-946c-46cf-9286-971cc0880a50" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.661143] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41681a5f-946c-46cf-9286-971cc0880a50" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.661398] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41681a5f-946c-46cf-9286-971cc0880a50" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.661485] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41681a5f-946c-46cf-9286-971cc0880a50',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.670149] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.670349] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-590" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.670472] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-590" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.671047] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-590" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.671330] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.671488] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.671601] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.671835] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.671973] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.672190] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.672297] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.672399] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.672680] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.672832] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.672938] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.673185] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 704.706076] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.706259] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 704.706420] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.706686] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-590" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.707013] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-e604decd-9fca-4cd9-83ce-61c532050bef taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.707189] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-e604decd-9fca-4cd9-83ce-61c532050bef" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.707301] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-e604decd-9fca-4cd9-83ce-61c532050bef" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.708074] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-e604decd-9fca-4cd9-83ce-61c532050bef" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.708228] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e604decd-9fca-4cd9-83ce-61c532050bef',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.753820] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.753820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.753820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.753820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.753820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.753820] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.753820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.753820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.753820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.754526] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.754526] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 already deleted. [ 704.754526] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.100261] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.165884] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41681a5f-946c-46cf-9286-971cc0880a50 [ 705.165884] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.165884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.165884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.165884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.165884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.165884] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41681a5f-946c-46cf-9286-971cc0880a50 already deleted. [ 705.165884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41681a5f-946c-46cf-9286-971cc0880a50" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.210680] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.210988] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.210988] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.211354] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.211572] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.211731] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port e604decd-9fca-4cd9-83ce-61c532050bef not found, creating... [ 705.212025] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.212213] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.212342] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.212551] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.212684] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.213437] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.213619] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.213737] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.213970] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.214116] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.214274] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: e604decd-9fca-4cd9-83ce-61c532050bef is going to be created. [ 705.239542] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.239542] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.239542] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.240816] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.240816] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.240816] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-e604decd-9fca-4cd9-83ce-61c532050bef" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.602876] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.603395] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.603395] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.603395] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.603559] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.603559] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 is going to be updated. [ 705.634904] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.635083] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.635935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.635935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.635935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.646058] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: IN_PROGRESS for 2s [ 706.050489] env[66834]: INFO networking_nsxv3.common.synchronization [req-7d83b6e5-9b56-4ae9-828d-12c2b06f1551 req-c189d764-83ec-4999-b7bb-1ccc003275e8 service nova] Enqueued Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGHEST for action security_group_rules [ 706.050824] env[66834]: INFO networking_nsxv3.common.synchronization [req-7d83b6e5-9b56-4ae9-828d-12c2b06f1551 req-c189d764-83ec-4999-b7bb-1ccc003275e8 service nova] Enqueued Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGHEST for action security_group_members [ 706.051244] env[66834]: INFO networking_nsxv3.common.synchronization [req-7d83b6e5-9b56-4ae9-828d-12c2b06f1551 req-c189d764-83ec-4999-b7bb-1ccc003275e8 service nova] Enqueued Resource ID: e604decd-9fca-4cd9-83ce-61c532050bef with Priority: HIGHEST for action port [ 706.051547] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGHEST for action security_group_rules [ 706.051674] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGHEST for action security_group_members [ 706.051767] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e604decd-9fca-4cd9-83ce-61c532050bef with Priority: HIGHEST for action port [ 706.052680] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.052913] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.053050] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.053307] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.053442] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.055109] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.055316] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.055559] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.055676] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.055946] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.056121] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.056240] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.056436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.057207] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.057207] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.059788] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-e604decd-9fca-4cd9-83ce-61c532050bef taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.059788] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e604decd-9fca-4cd9-83ce-61c532050bef" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.059788] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e604decd-9fca-4cd9-83ce-61c532050bef" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.059788] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e604decd-9fca-4cd9-83ce-61c532050bef" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.059788] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e604decd-9fca-4cd9-83ce-61c532050bef',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.216099] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01965726-b599-4a24-a0ef-beaaba998cf3 in Status: SUCCESS [ 706.217591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.561860] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.563332] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.563332] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.563332] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e604decd-9fca-4cd9-83ce-61c532050bef with status ACTIVE [ 706.563332] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.563332] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.563614] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.563614] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.563665] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.563885] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.563992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.564096] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.565043] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.566792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.566792] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.566792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.566792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.566792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.566792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.566792] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e604decd-9fca-4cd9-83ce-61c532050bef is going to be updated. [ 706.589837] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.591040] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.591040] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.591040] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.591193] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.591266] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e604decd-9fca-4cd9-83ce-61c532050bef" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.069789] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.200961] env[66834]: INFO networking_nsxv3.common.synchronization [None req-28749fc6-e6c5-4c4a-ac19-a0f5b4a49733 None None] Enqueued Resource ID: 51bd4ce2-6cf1-4b31-bc86-abf2e885fd78 with Priority: HIGHEST for action port [ 707.201677] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51bd4ce2-6cf1-4b31-bc86-abf2e885fd78 with Priority: HIGHEST for action port [ 707.202394] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-51bd4ce2-6cf1-4b31-bc86-abf2e885fd78 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.202760] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51bd4ce2-6cf1-4b31-bc86-abf2e885fd78" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.202837] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51bd4ce2-6cf1-4b31-bc86-abf2e885fd78" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.203829] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51bd4ce2-6cf1-4b31-bc86-abf2e885fd78" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.203829] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51bd4ce2-6cf1-4b31-bc86-abf2e885fd78',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.575406] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.575550] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.575626] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.575872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.575941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.576050] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 is going to be created. [ 707.610027] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.610027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.610027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.610027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.610027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.633494] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 in Status: UNINITIALIZED for 2s [ 707.657828] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: IN_PROGRESS for 4s [ 707.706421] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 51bd4ce2-6cf1-4b31-bc86-abf2e885fd78 [ 707.707160] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.707160] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.707295] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.707512] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.707585] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.707683] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:51bd4ce2-6cf1-4b31-bc86-abf2e885fd78 already deleted. [ 707.707747] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51bd4ce2-6cf1-4b31-bc86-abf2e885fd78" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.499280] env[66834]: INFO networking_nsxv3.common.synchronization [req-ce87aa32-f5dc-499e-a281-6d8e05af6ae7 req-e3f63641-7d85-4598-86e5-f5fd986774f4 tempest-ServerAddressesTestJSON-1233461938 tempest-ServerAddressesTestJSON-1233461938-project-member] Enqueued Resource ID: 98a1f729-8e05-4426-8db7-2c883443f0e8 with Priority: HIGHEST for action security_group_members [ 709.499831] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98a1f729-8e05-4426-8db7-2c883443f0e8 with Priority: HIGHEST for action security_group_members [ 709.501034] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-98a1f729-8e05-4426-8db7-2c883443f0e8 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.501034] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.501034] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.501259] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.501521] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.501689] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.501689] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.501860] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.501946] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.502071] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98a1f729-8e05-4426-8db7-2c883443f0e8',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.650286] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 in Status: SUCCESS [ 709.650422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.650710] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.650870] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.651097] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.651448] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.651533] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.651800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.651869] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.651970] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.652378] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.670805] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: SUCCESS [ 709.670805] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.674372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.674372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.674372] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.674372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.674372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.674372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.674372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.674372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.674372] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.004879] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.005058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.005171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.005380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.005575] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.005674] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.005768] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.005940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.005994] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.006060] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.006144] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98a1f729-8e05-4426-8db7-2c883443f0e8 is going to be updated. [ 710.040024] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.040024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.040024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.040024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.040024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.047826] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98a1f729-8e05-4426-8db7-2c883443f0e8 in Status: IN_PROGRESS for 2s [ 710.156530] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.177674] env[66834]: INFO networking_nsxv3.common.synchronization [req-16baff4e-3b51-45a2-816d-ad0046e69176 req-c5afde0e-f198-4508-b293-9ad73cb47fce tempest-ServersAdminNegativeTestJSON-1367226242 tempest-ServersAdminNegativeTestJSON-1367226242-project-member] Enqueued Resource ID: 06c1d39f-c76e-47c4-9900-046863c4e37a with Priority: HIGHEST for action security_group_members [ 710.178423] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06c1d39f-c76e-47c4-9900-046863c4e37a with Priority: HIGHEST for action security_group_members [ 710.178810] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06c1d39f-c76e-47c4-9900-046863c4e37a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.178933] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.178933] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.179330] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.179330] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.179512] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.179512] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.179727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.179727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.179845] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06c1d39f-c76e-47c4-9900-046863c4e37a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.180705] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.180830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.180891] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.181046] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.181191] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.181509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.181509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.181650] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.181738] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.181824] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.181972] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.182995] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.183104] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.183262] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.183676] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.183676] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.183676] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.184090] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.184090] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.184090] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.184090] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.470706] env[66834]: INFO networking_nsxv3.common.synchronization [None req-2af71699-60ab-427d-a798-21fb148fce71 None None] Enqueued Resource ID: 63f49900-16e8-4389-ba46-b4cb97ab858c with Priority: HIGHEST for action port [ 710.471276] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63f49900-16e8-4389-ba46-b4cb97ab858c with Priority: HIGHEST for action port [ 710.472112] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-63f49900-16e8-4389-ba46-b4cb97ab858c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.472268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63f49900-16e8-4389-ba46-b4cb97ab858c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.472348] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63f49900-16e8-4389-ba46-b4cb97ab858c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.472652] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63f49900-16e8-4389-ba46-b4cb97ab858c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.472796] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63f49900-16e8-4389-ba46-b4cb97ab858c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.661024] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997: rpc.has_security_group_logging(os_id): False [ 710.686624] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06c1d39f-c76e-47c4-9900-046863c4e37a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.687671] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 599d582a-c0d7-4df7-a1fe-3e63412d8939: rpc.has_security_group_logging(os_id): False [ 710.690081] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.690548] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.690801] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.690910] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.691010] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.691275] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.691403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.691450] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.691608] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.691683] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.691771] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 is going to be created. [ 710.711912] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.712070] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.712141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.712346] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.712436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.712648] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.712829] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.712906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.713071] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.713150] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.713338] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.713438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.713506] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.713625] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.713697] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.713870] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.713963] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.714032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.714169] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.714240] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.714334] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 is going to be updated. [ 710.846287] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-582 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.846287] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.846287] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.846498] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.846750] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.846911] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.847047] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.847266] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.847407] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.847611] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.847715] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 710.847815] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 710.847915] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 710.848033] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.848126] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 710.848251] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 710.855227] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.855361] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.855361] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.855540] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.855712] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.871671] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 in Status: IN_PROGRESS for 2s [ 710.872614] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 710.872761] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 710.872890] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 710.873126] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.873492] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-18bac878-b194-449d-82db-1ccc464d73ff taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.873674] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-18bac878-b194-449d-82db-1ccc464d73ff" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.873766] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-18bac878-b194-449d-82db-1ccc464d73ff" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.874162] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-18bac878-b194-449d-82db-1ccc464d73ff" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.874295] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18bac878-b194-449d-82db-1ccc464d73ff',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.875959] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.876087] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.876161] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.876350] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.876494] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.890798] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: IN_PROGRESS for 2s [ 710.974954] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 63f49900-16e8-4389-ba46-b4cb97ab858c [ 710.975253] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.975453] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.975569] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.975934] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.976195] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.976301] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:63f49900-16e8-4389-ba46-b4cb97ab858c already deleted. [ 710.976507] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63f49900-16e8-4389-ba46-b4cb97ab858c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.190328] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06c1d39f-c76e-47c4-9900-046863c4e37a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.378903] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.379508] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.379508] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.379697] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.379941] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.380171] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 18bac878-b194-449d-82db-1ccc464d73ff not found, creating... [ 711.380452] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.380608] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.380786] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.380941] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.381089] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.381379] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.381528] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.381642] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.381843] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.381979] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.382329] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 18bac878-b194-449d-82db-1ccc464d73ff is going to be created. [ 711.408567] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.408567] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.408904] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.408904] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.409185] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.409431] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-18bac878-b194-449d-82db-1ccc464d73ff" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.693580] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.693580] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.693580] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.693580] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.694105] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.694105] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06c1d39f-c76e-47c4-9900-046863c4e37a is going to be updated. [ 711.731591] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.731748] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.731786] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.731991] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.732152] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.760111] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06c1d39f-c76e-47c4-9900-046863c4e37a in Status: IN_PROGRESS for 2s [ 712.060914] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98a1f729-8e05-4426-8db7-2c883443f0e8 in Status: SUCCESS [ 712.061104] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98a1f729-8e05-4426-8db7-2c883443f0e8 deletion is rescheduled due to dependency. [ 712.061218] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.145313] env[66834]: INFO networking_nsxv3.common.synchronization [req-16baff4e-3b51-45a2-816d-ad0046e69176 req-46333d21-81a9-42bc-95cb-e30052bd1dc7 service nova] Enqueued Resource ID: 06c1d39f-c76e-47c4-9900-046863c4e37a with Priority: HIGHEST for action security_group_rules [ 712.145313] env[66834]: INFO networking_nsxv3.common.synchronization [req-16baff4e-3b51-45a2-816d-ad0046e69176 req-46333d21-81a9-42bc-95cb-e30052bd1dc7 service nova] Enqueued Resource ID: 06c1d39f-c76e-47c4-9900-046863c4e37a with Priority: HIGHEST for action security_group_members [ 712.145313] env[66834]: INFO networking_nsxv3.common.synchronization [req-16baff4e-3b51-45a2-816d-ad0046e69176 req-46333d21-81a9-42bc-95cb-e30052bd1dc7 service nova] Enqueued Resource ID: 18bac878-b194-449d-82db-1ccc464d73ff with Priority: HIGHEST for action port [ 712.145313] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06c1d39f-c76e-47c4-9900-046863c4e37a with Priority: HIGHEST for action security_group_rules [ 712.145313] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06c1d39f-c76e-47c4-9900-046863c4e37a with Priority: HIGHEST for action security_group_members [ 712.145313] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18bac878-b194-449d-82db-1ccc464d73ff with Priority: HIGHEST for action port [ 712.145561] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06c1d39f-c76e-47c4-9900-046863c4e37a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.145632] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.145678] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.145865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.145969] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06c1d39f-c76e-47c4-9900-046863c4e37a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.147349] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06c1d39f-c76e-47c4-9900-046863c4e37a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.147440] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.147619] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-18bac878-b194-449d-82db-1ccc464d73ff taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.147718] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18bac878-b194-449d-82db-1ccc464d73ff" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.147772] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18bac878-b194-449d-82db-1ccc464d73ff" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.148284] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18bac878-b194-449d-82db-1ccc464d73ff" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.148284] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18bac878-b194-449d-82db-1ccc464d73ff',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.649436] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06c1d39f-c76e-47c4-9900-046863c4e37a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.649436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.650632] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18bac878-b194-449d-82db-1ccc464d73ff with status ACTIVE [ 712.651105] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.654022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.654022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.654022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.654022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.654022] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.654022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.654022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.654022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.654022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.654022] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.654022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.654022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.654022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.654022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.654022] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18bac878-b194-449d-82db-1ccc464d73ff is going to be updated. [ 712.678436] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.678436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.678436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.678436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.678436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.678436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18bac878-b194-449d-82db-1ccc464d73ff" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.820053] env[66834]: INFO networking_nsxv3.common.synchronization [None req-506bfb48-84d4-45cf-bb4f-0dbddc594402 None None] Enqueued Resource ID: 1e2dd09d-22a6-49fd-aedf-f0d5cf5428bf with Priority: HIGHEST for action port [ 712.820053] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e2dd09d-22a6-49fd-aedf-f0d5cf5428bf with Priority: HIGHEST for action port [ 712.821145] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e2dd09d-22a6-49fd-aedf-f0d5cf5428bf taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.821456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e2dd09d-22a6-49fd-aedf-f0d5cf5428bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.821609] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e2dd09d-22a6-49fd-aedf-f0d5cf5428bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.822301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e2dd09d-22a6-49fd-aedf-f0d5cf5428bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.823946] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e2dd09d-22a6-49fd-aedf-f0d5cf5428bf',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.884187] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 in Status: SUCCESS [ 712.884422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.906026] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: SUCCESS [ 712.906249] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.320036] env[66834]: INFO networking_nsxv3.common.synchronization [None req-dec5c111-8f0d-44a1-9d0b-9f68a47921f5 None None] Enqueued Resource ID: 4b099d2a-c5e6-4f31-bca3-6b2d78dfa994 with Priority: HIGHEST for action port [ 713.320036] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b099d2a-c5e6-4f31-bca3-6b2d78dfa994 with Priority: HIGHEST for action port [ 713.320036] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b099d2a-c5e6-4f31-bca3-6b2d78dfa994 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.320036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b099d2a-c5e6-4f31-bca3-6b2d78dfa994" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.320036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b099d2a-c5e6-4f31-bca3-6b2d78dfa994" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.320693] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b099d2a-c5e6-4f31-bca3-6b2d78dfa994" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.320913] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b099d2a-c5e6-4f31-bca3-6b2d78dfa994',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.330499] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e2dd09d-22a6-49fd-aedf-f0d5cf5428bf [ 713.330499] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.330499] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.330499] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.330499] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.330921] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.330921] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e2dd09d-22a6-49fd-aedf-f0d5cf5428bf already deleted. [ 713.330921] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e2dd09d-22a6-49fd-aedf-f0d5cf5428bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.778773] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06c1d39f-c76e-47c4-9900-046863c4e37a in Status: SUCCESS [ 713.779039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.779317] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.779558] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.779740] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.779884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.779953] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.780144] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.783030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.783030] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06c1d39f-c76e-47c4-9900-046863c4e37a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.823018] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b099d2a-c5e6-4f31-bca3-6b2d78dfa994 [ 713.823307] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.823412] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.823480] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.823731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.823781] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.823872] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b099d2a-c5e6-4f31-bca3-6b2d78dfa994 already deleted. [ 713.823934] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b099d2a-c5e6-4f31-bca3-6b2d78dfa994" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.127762] env[66834]: INFO networking_nsxv3.common.synchronization [None req-a409bce5-4c9d-4175-885e-2eaeff129ea5 tempest-AttachInterfacesTestJSON-77868371 tempest-AttachInterfacesTestJSON-77868371-project-member] Enqueued Resource ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 with Priority: HIGHEST for action security_group_rules [ 714.128405] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 with Priority: HIGHEST for action security_group_rules [ 714.128734] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b0294dc-2245-46bf-a56e-f22fbf616a62 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.128914] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.128914] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.130971] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.130971] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b0294dc-2245-46bf-a56e-f22fbf616a62',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.283637] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06c1d39f-c76e-47c4-9900-046863c4e37a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.324168] env[66834]: INFO networking_nsxv3.common.synchronization [None req-5b8b730c-1fd0-4e3f-9700-e1b3b49783cf tempest-AttachInterfacesTestJSON-77868371 tempest-AttachInterfacesTestJSON-77868371-project-member] Enqueued Resource ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 with Priority: HIGHEST for action security_group_rules [ 714.324168] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 with Priority: HIGHEST for action security_group_rules [ 714.324168] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b0294dc-2245-46bf-a56e-f22fbf616a62 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.324536] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.655042] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.655269] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.655385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.655702] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.655870] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.656043] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 already deleted. [ 714.656224] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.656456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.656729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.657567] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b0294dc-2245-46bf-a56e-f22fbf616a62',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.788072] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06c1d39f-c76e-47c4-9900-046863c4e37a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.182242] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.182242] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.182242] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.182242] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.182242] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.182596] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 already deleted. [ 715.182596] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.234900] env[66834]: INFO networking_nsxv3.common.synchronization [req-5c72d7ab-c8d1-4c69-9ed5-9b89cb35101d req-40b7ad93-0fd3-4e4b-9dc3-0d3cbb5ef8ff tempest-ServerTagsTestJSON-2062520612 tempest-ServerTagsTestJSON-2062520612-project-member] Enqueued Resource ID: a4da628c-f2f0-417c-917f-a8cc4350870b with Priority: HIGHEST for action security_group_members [ 715.235521] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4da628c-f2f0-417c-917f-a8cc4350870b with Priority: HIGHEST for action security_group_members [ 715.236098] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4da628c-f2f0-417c-917f-a8cc4350870b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.236098] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.236772] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.237147] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.237332] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.237449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.237532] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.237697] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.237785] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.237880] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4da628c-f2f0-417c-917f-a8cc4350870b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.292574] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.292908] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.292908] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.293066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.293167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.293374] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06c1d39f-c76e-47c4-9900-046863c4e37a is going to be updated. [ 715.329038] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.329186] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.329242] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.329792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.329792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.347662] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06c1d39f-c76e-47c4-9900-046863c4e37a in Status: IN_PROGRESS for 2s [ 715.402204] env[66834]: INFO networking_nsxv3.common.synchronization [None req-6c51b2b9-a172-46a0-815a-f2350e51b157 tempest-ServersTestJSON-2040502537 tempest-ServersTestJSON-2040502537-project-member] Enqueued Resource ID: 61dc46c7-365b-480f-83e5-16cbc578a879 with Priority: HIGHEST for action security_group_rules [ 715.403521] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61dc46c7-365b-480f-83e5-16cbc578a879 with Priority: HIGHEST for action security_group_rules [ 715.405032] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61dc46c7-365b-480f-83e5-16cbc578a879 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.405032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.405032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.405032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.405032] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61dc46c7-365b-480f-83e5-16cbc578a879',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.550024] env[66834]: INFO networking_nsxv3.common.synchronization [None req-c9cea2cc-cace-460d-8477-870ae0e61821 None None] Enqueued Resource ID: e80c9f42-aaf7-407d-aa26-3697f019fc05 with Priority: HIGHEST for action port [ 715.550024] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e80c9f42-aaf7-407d-aa26-3697f019fc05 with Priority: HIGHEST for action port [ 715.550024] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-e80c9f42-aaf7-407d-aa26-3697f019fc05 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.550024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e80c9f42-aaf7-407d-aa26-3697f019fc05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.550024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e80c9f42-aaf7-407d-aa26-3697f019fc05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.550638] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e80c9f42-aaf7-407d-aa26-3697f019fc05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.550934] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e80c9f42-aaf7-407d-aa26-3697f019fc05',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.628233] env[66834]: INFO networking_nsxv3.common.synchronization [req-f936c9bc-a76e-493c-9c22-2577ee1e84ad req-e7262d3c-35f8-450e-b9dc-eadafab7f874 tempest-ServerDiskConfigTestJSON-362503924 tempest-ServerDiskConfigTestJSON-362503924-project-member] Enqueued Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 715.628982] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 715.629404] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.630333] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.630333] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.630333] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.630333] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.630333] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.630333] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.630333] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.630333] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.630638] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.713971] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-691 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.714211] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-691" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.714335] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-691" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.714645] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-691" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.714899] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.716409] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.716584] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.716824] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.717041] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.717185] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.717290] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.717394] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.717493] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.717593] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.717690] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.717810] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 715.737172] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 715.737460] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 715.737595] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 715.737766] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-691" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.738591] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-c1b4a032-9a5e-4fbd-8915-0e4f8839bf75 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.738591] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-c1b4a032-9a5e-4fbd-8915-0e4f8839bf75" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.738591] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-c1b4a032-9a5e-4fbd-8915-0e4f8839bf75" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.738846] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-c1b4a032-9a5e-4fbd-8915-0e4f8839bf75" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.740450] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1b4a032-9a5e-4fbd-8915-0e4f8839bf75',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.744143] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.744349] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.744620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.744720] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.744794] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.745083] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.745225] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.745316] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.745532] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.747032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.747032] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4da628c-f2f0-417c-917f-a8cc4350870b already deleted. [ 715.747032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.926457] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.926705] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.926780] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.927056] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.927129] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.927225] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61dc46c7-365b-480f-83e5-16cbc578a879 already deleted. [ 715.927319] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.054687] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e80c9f42-aaf7-407d-aa26-3697f019fc05 [ 716.055081] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.055288] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.055393] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.055727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.055841] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.055987] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e80c9f42-aaf7-407d-aa26-3697f019fc05 already deleted. [ 716.056128] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e80c9f42-aaf7-407d-aa26-3697f019fc05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.133707] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.133949] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.134063] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.134340] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.134572] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.134706] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.134824] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.134908] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.135141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.135288] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.135409] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7963c125-23b5-45fd-8158-f6470d12949e is going to be updated. [ 716.179175] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.179373] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.179492] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.179718] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.179902] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.190659] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: IN_PROGRESS for 2s [ 716.241582] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.242119] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.242251] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.242520] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.242695] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.242965] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port c1b4a032-9a5e-4fbd-8915-0e4f8839bf75 not found, creating... [ 716.243295] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.243486] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.243548] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.243821] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.244102] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.244375] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.244596] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.244734] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.245175] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.245417] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.245617] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: c1b4a032-9a5e-4fbd-8915-0e4f8839bf75 is going to be created. [ 716.271319] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.271319] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.271319] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.271319] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.271319] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.271683] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-c1b4a032-9a5e-4fbd-8915-0e4f8839bf75" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.717463] env[66834]: INFO networking_nsxv3.common.synchronization [None req-8485a155-6eae-47a0-9051-49cad111c76b tempest-ServersTestJSON-2040502537 tempest-ServersTestJSON-2040502537-project-member] Enqueued Resource ID: 61dc46c7-365b-480f-83e5-16cbc578a879 with Priority: HIGHEST for action security_group_rules [ 716.718469] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61dc46c7-365b-480f-83e5-16cbc578a879 with Priority: HIGHEST for action security_group_rules [ 716.718801] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61dc46c7-365b-480f-83e5-16cbc578a879 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.718927] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.718997] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.719239] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.719297] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61dc46c7-365b-480f-83e5-16cbc578a879',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.000180] env[66834]: INFO networking_nsxv3.common.synchronization [req-5c72d7ab-c8d1-4c69-9ed5-9b89cb35101d req-25e94314-423e-43b0-875c-e6b8fe10eddd service nova] Enqueued Resource ID: a4da628c-f2f0-417c-917f-a8cc4350870b with Priority: HIGHEST for action security_group_rules [ 717.000794] env[66834]: INFO networking_nsxv3.common.synchronization [req-5c72d7ab-c8d1-4c69-9ed5-9b89cb35101d req-25e94314-423e-43b0-875c-e6b8fe10eddd service nova] Enqueued Resource ID: a4da628c-f2f0-417c-917f-a8cc4350870b with Priority: HIGHEST for action security_group_members [ 717.000984] env[66834]: INFO networking_nsxv3.common.synchronization [req-5c72d7ab-c8d1-4c69-9ed5-9b89cb35101d req-25e94314-423e-43b0-875c-e6b8fe10eddd service nova] Enqueued Resource ID: c1b4a032-9a5e-4fbd-8915-0e4f8839bf75 with Priority: HIGHEST for action port [ 717.001619] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4da628c-f2f0-417c-917f-a8cc4350870b with Priority: HIGHEST for action security_group_rules [ 717.001778] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4da628c-f2f0-417c-917f-a8cc4350870b with Priority: HIGHEST for action security_group_members [ 717.001902] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1b4a032-9a5e-4fbd-8915-0e4f8839bf75 with Priority: HIGHEST for action port [ 717.003049] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4da628c-f2f0-417c-917f-a8cc4350870b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.003049] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.003049] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.003049] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.003049] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4da628c-f2f0-417c-917f-a8cc4350870b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.003775] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4da628c-f2f0-417c-917f-a8cc4350870b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.003891] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.003959] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.004784] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.004784] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.004784] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.005103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.005103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.005103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.005190] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4da628c-f2f0-417c-917f-a8cc4350870b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.006654] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1b4a032-9a5e-4fbd-8915-0e4f8839bf75 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.006726] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1b4a032-9a5e-4fbd-8915-0e4f8839bf75" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.006797] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1b4a032-9a5e-4fbd-8915-0e4f8839bf75" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.006923] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1b4a032-9a5e-4fbd-8915-0e4f8839bf75" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.007012] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1b4a032-9a5e-4fbd-8915-0e4f8839bf75',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.245811] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.246108] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.246108] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.246260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.246353] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.246471] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61dc46c7-365b-480f-83e5-16cbc578a879 already deleted. [ 717.246562] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.357877] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06c1d39f-c76e-47c4-9900-046863c4e37a in Status: SUCCESS [ 717.358316] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.358482] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.358829] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.359158] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.359371] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.359509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.359804] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.359957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.360846] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.360948] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06c1d39f-c76e-47c4-9900-046863c4e37a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.508926] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4da628c-f2f0-417c-917f-a8cc4350870b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.512014] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.512014] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4da628c-f2f0-417c-917f-a8cc4350870b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.512014] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c1b4a032-9a5e-4fbd-8915-0e4f8839bf75 with status ACTIVE [ 717.512014] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.512014] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.512014] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.512014] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.512014] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.512014] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.512014] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.512014] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.512014] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.512551] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.512551] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.512551] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.512551] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.512666] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.512692] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.513519] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c1b4a032-9a5e-4fbd-8915-0e4f8839bf75 is going to be updated. [ 717.535832] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.536141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.537075] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.537075] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.537075] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.537075] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1b4a032-9a5e-4fbd-8915-0e4f8839bf75" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.864195] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06c1d39f-c76e-47c4-9900-046863c4e37a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.864334] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.864403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.864624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.864786] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.864886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.864949] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.865118] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.865203] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.865292] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.865436] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06c1d39f-c76e-47c4-9900-046863c4e37a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.865533] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.865593] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.865744] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.865885] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.865949] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.866014] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.866156] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.867580] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.867580] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.867580] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06c1d39f-c76e-47c4-9900-046863c4e37a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.016885] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4da628c-f2f0-417c-917f-a8cc4350870b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.104046] env[66834]: INFO networking_nsxv3.common.synchronization [req-aa0807f6-8730-41fe-bb2f-c389d021f4f7 req-77d4ff92-8aae-4a38-b891-55f5eeb4211e tempest-ServersAdminTestJSON-835845617 tempest-ServersAdminTestJSON-835845617-project-member] Enqueued Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_members [ 718.104612] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_members [ 718.106154] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.106154] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.106154] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.106154] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.106154] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.106154] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.106154] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.106570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.106570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.106835] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.203161] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: SUCCESS [ 718.204013] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7963c125-23b5-45fd-8158-f6470d12949e deletion is rescheduled due to dependency. [ 718.204338] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.371136] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06c1d39f-c76e-47c4-9900-046863c4e37a: rpc.has_security_group_logging(os_id): False [ 718.389054] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.389213] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.389286] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.389477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.389594] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.389817] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.389921] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.389982] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.390154] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.390233] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.390406] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.390539] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.390595] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.390691] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.391546] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.391546] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.391546] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.391546] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.391546] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.391546] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.391546] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06c1d39f-c76e-47c4-9900-046863c4e37a is going to be updated. [ 718.478642] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.478797] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.478868] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.479093] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.479798] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.498435] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06c1d39f-c76e-47c4-9900-046863c4e37a in Status: IN_PROGRESS for 2s [ 718.521614] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.521808] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.521913] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.522209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.522334] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.522486] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4da628c-f2f0-417c-917f-a8cc4350870b is going to be created. [ 718.575068] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.575309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.575469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.576585] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.576585] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.593008] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4da628c-f2f0-417c-917f-a8cc4350870b in Status: UNINITIALIZED for 2s [ 718.610177] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.610369] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.610369] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.610502] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.610617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.610818] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.610928] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.610992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.611169] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.611241] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.611327] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9276c5a5-af43-4c6e-899f-c34039400160 already deleted. [ 718.611405] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.960387] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-958 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.960572] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-958" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.960748] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-958" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.961084] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-958" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.961347] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.961498] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.961600] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.961804] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.961932] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.962149] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.962247] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 718.962348] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 718.962445] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 718.962540] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.962637] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 718.962754] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 718.981160] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 718.981331] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 718.981434] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 718.981604] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-958" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.981905] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-a8086c76-33f8-4f48-9581-9fcddc26f04c taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.982081] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-a8086c76-33f8-4f48-9581-9fcddc26f04c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.982194] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-a8086c76-33f8-4f48-9581-9fcddc26f04c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.982507] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-a8086c76-33f8-4f48-9581-9fcddc26f04c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.982640] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8086c76-33f8-4f48-9581-9fcddc26f04c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.437643] env[66834]: INFO networking_nsxv3.common.synchronization [None req-42f32997-c989-49e9-a401-9ef91cf9bfee tempest-MigrationsAdminTest-1673437967 tempest-MigrationsAdminTest-1673437967-project-member] Enqueued Resource ID: 74f5da29-9813-4267-9403-b31dc8901729 with Priority: HIGHEST for action security_group_rules [ 719.438230] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74f5da29-9813-4267-9403-b31dc8901729 with Priority: HIGHEST for action security_group_rules [ 719.438607] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74f5da29-9813-4267-9403-b31dc8901729 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.438784] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74f5da29-9813-4267-9403-b31dc8901729" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.438784] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74f5da29-9813-4267-9403-b31dc8901729" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.439082] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74f5da29-9813-4267-9403-b31dc8901729" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.439169] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74f5da29-9813-4267-9403-b31dc8901729',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.485063] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.485417] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.485634] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.486017] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.486334] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.486513] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port a8086c76-33f8-4f48-9581-9fcddc26f04c not found, creating... [ 719.486869] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.487326] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.487772] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.488572] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.488713] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.489073] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.489314] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.489691] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.489790] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.490105] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.490345] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: a8086c76-33f8-4f48-9581-9fcddc26f04c is going to be created. [ 719.513575] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.515365] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.515365] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.515365] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.515365] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.515365] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-a8086c76-33f8-4f48-9581-9fcddc26f04c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.781583] env[66834]: INFO networking_nsxv3.common.synchronization [None req-ade53ffd-2c4a-41f7-9639-0e36a9fc1c0a tempest-MigrationsAdminTest-1673437967 tempest-MigrationsAdminTest-1673437967-project-member] Enqueued Resource ID: 74f5da29-9813-4267-9403-b31dc8901729 with Priority: HIGHEST for action security_group_rules [ 719.782138] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74f5da29-9813-4267-9403-b31dc8901729 with Priority: HIGHEST for action security_group_rules [ 719.782793] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74f5da29-9813-4267-9403-b31dc8901729 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.782892] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74f5da29-9813-4267-9403-b31dc8901729" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.960691] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.960856] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.960892] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.961146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.961239] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.961335] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74f5da29-9813-4267-9403-b31dc8901729 already deleted. [ 719.961443] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74f5da29-9813-4267-9403-b31dc8901729" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.961570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74f5da29-9813-4267-9403-b31dc8901729" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.961721] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74f5da29-9813-4267-9403-b31dc8901729" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.961806] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74f5da29-9813-4267-9403-b31dc8901729',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.212799] env[66834]: INFO networking_nsxv3.common.synchronization [req-aa0807f6-8730-41fe-bb2f-c389d021f4f7 req-7a8b57ce-5d67-44c8-9efa-e9297f7d80eb service nova] Enqueued Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_rules [ 720.212976] env[66834]: INFO networking_nsxv3.common.synchronization [req-aa0807f6-8730-41fe-bb2f-c389d021f4f7 req-7a8b57ce-5d67-44c8-9efa-e9297f7d80eb service nova] Enqueued Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_members [ 720.213130] env[66834]: INFO networking_nsxv3.common.synchronization [req-aa0807f6-8730-41fe-bb2f-c389d021f4f7 req-7a8b57ce-5d67-44c8-9efa-e9297f7d80eb service nova] Enqueued Resource ID: a8086c76-33f8-4f48-9581-9fcddc26f04c with Priority: HIGHEST for action port [ 720.213919] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_rules [ 720.213919] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_members [ 720.213919] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8086c76-33f8-4f48-9581-9fcddc26f04c with Priority: HIGHEST for action port [ 720.214322] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.214322] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.214322] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.214618] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.214618] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.216497] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.216497] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.216497] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.216497] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.216497] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.216497] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.216497] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.216497] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.216497] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.216497] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.218063] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8086c76-33f8-4f48-9581-9fcddc26f04c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.218063] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8086c76-33f8-4f48-9581-9fcddc26f04c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.218063] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8086c76-33f8-4f48-9581-9fcddc26f04c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.218063] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8086c76-33f8-4f48-9581-9fcddc26f04c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.218063] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8086c76-33f8-4f48-9581-9fcddc26f04c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.486072] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.486437] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.487093] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.487093] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.487093] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.487315] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74f5da29-9813-4267-9403-b31dc8901729 already deleted. [ 720.487371] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74f5da29-9813-4267-9403-b31dc8901729" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.512914] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06c1d39f-c76e-47c4-9900-046863c4e37a in Status: SUCCESS [ 720.513232] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.603351] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4da628c-f2f0-417c-917f-a8cc4350870b in Status: SUCCESS [ 720.603563] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.603803] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.604131] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.604242] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.604356] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.604419] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.604568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.604649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.604763] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.604812] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4da628c-f2f0-417c-917f-a8cc4350870b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.721487] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.721617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.722990] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.727808] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8086c76-33f8-4f48-9581-9fcddc26f04c with status ACTIVE [ 720.727808] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.727808] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.727808] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.727808] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.727808] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.727808] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.727808] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.727808] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.727808] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.727808] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.727808] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.727808] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.727808] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.727808] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.727808] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.727808] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8086c76-33f8-4f48-9581-9fcddc26f04c is going to be updated. [ 720.749996] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.750155] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.750224] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.750423] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.750557] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.750715] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8086c76-33f8-4f48-9581-9fcddc26f04c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.808704] env[66834]: INFO networking_nsxv3.common.synchronization [req-2cdd5204-471b-44ad-990c-76d54a977c89 req-d8a97931-40f0-4a24-b5dd-deb6d2e8ebb6 tempest-ServersAdminTestJSON-835845617 tempest-ServersAdminTestJSON-835845617-project-member] Enqueued Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_members [ 720.809261] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_members [ 720.809940] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.810142] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.110172] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4da628c-f2f0-417c-917f-a8cc4350870b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.110252] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.110369] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.110596] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.110780] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.110920] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.110979] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.111146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.111241] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.111330] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.111480] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4da628c-f2f0-417c-917f-a8cc4350870b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.111598] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.111655] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.111800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.111936] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.112030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.112082] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.112219] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.112288] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.112376] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.112463] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4da628c-f2f0-417c-917f-a8cc4350870b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.225922] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.345899] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-958 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.346100] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-958" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.346221] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-958" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.346679] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-958" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.346942] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.348035] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.348035] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.348035] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.348035] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.348035] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.348231] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.348231] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.348398] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.348398] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.348536] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.348709] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.378222] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.378540] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 721.378696] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.378954] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-958" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.379368] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-b772634c-7768-4ad7-9821-3eaa2c384f12 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.379595] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-b772634c-7768-4ad7-9821-3eaa2c384f12" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.379749] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-b772634c-7768-4ad7-9821-3eaa2c384f12" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.380086] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-b772634c-7768-4ad7-9821-3eaa2c384f12" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.380225] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b772634c-7768-4ad7-9821-3eaa2c384f12',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.618633] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4da628c-f2f0-417c-917f-a8cc4350870b: rpc.has_security_group_logging(os_id): False [ 721.642465] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.642653] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.642696] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.642897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.642987] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.643194] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.643295] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.643356] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.643507] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.643582] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.643796] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.643941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.644027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.644289] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.644289] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.644443] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.644536] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.644597] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.644734] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.644804] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.644886] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4da628c-f2f0-417c-917f-a8cc4350870b is going to be created. [ 721.719172] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.719468] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.719631] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.719899] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.720259] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.729110] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.729277] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.729277] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.729711] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.729838] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.730064] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9276c5a5-af43-4c6e-899f-c34039400160 is going to be created. [ 721.732285] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4da628c-f2f0-417c-917f-a8cc4350870b in Status: IN_PROGRESS for 2s [ 721.757399] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.757735] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.757893] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.758169] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.758485] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.777360] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: UNINITIALIZED for 2s [ 721.882693] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.882977] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.883174] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.883546] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.883743] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.883937] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port b772634c-7768-4ad7-9821-3eaa2c384f12 not found, creating... [ 721.884291] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.884488] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.884633] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.884946] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.885129] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.885536] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.885745] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.885890] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.886168] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.886329] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.886519] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: b772634c-7768-4ad7-9821-3eaa2c384f12 is going to be created. [ 721.908180] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.908394] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.908560] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.908840] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.909071] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.909290] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-b772634c-7768-4ad7-9821-3eaa2c384f12" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.636647] env[66834]: INFO networking_nsxv3.common.synchronization [req-2cdd5204-471b-44ad-990c-76d54a977c89 req-1d2aba96-f729-4fee-af6a-e0ff3d979285 service nova] Enqueued Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_rules [ 722.636918] env[66834]: INFO networking_nsxv3.common.synchronization [req-2cdd5204-471b-44ad-990c-76d54a977c89 req-1d2aba96-f729-4fee-af6a-e0ff3d979285 service nova] Enqueued Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_members [ 722.636958] env[66834]: INFO networking_nsxv3.common.synchronization [req-2cdd5204-471b-44ad-990c-76d54a977c89 req-1d2aba96-f729-4fee-af6a-e0ff3d979285 service nova] Enqueued Resource ID: b772634c-7768-4ad7-9821-3eaa2c384f12 with Priority: HIGHEST for action port [ 722.637525] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_rules [ 722.637650] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_members [ 722.637742] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b772634c-7768-4ad7-9821-3eaa2c384f12 with Priority: HIGHEST for action port [ 722.638019] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.638824] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.638824] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.638824] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.639061] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-b772634c-7768-4ad7-9821-3eaa2c384f12 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.639131] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b772634c-7768-4ad7-9821-3eaa2c384f12" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.639168] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b772634c-7768-4ad7-9821-3eaa2c384f12" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.639351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b772634c-7768-4ad7-9821-3eaa2c384f12" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.639593] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b772634c-7768-4ad7-9821-3eaa2c384f12',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.145063] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b772634c-7768-4ad7-9821-3eaa2c384f12 with status ACTIVE [ 723.145063] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.145063] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.145063] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.145646] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.145646] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.145646] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.145646] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.145646] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.145808] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.145808] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.145995] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.146150] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.146150] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.146223] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.146307] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.147206] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b772634c-7768-4ad7-9821-3eaa2c384f12 is going to be updated. [ 723.173916] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.173916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.173916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.173916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.173916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.174136] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b772634c-7768-4ad7-9821-3eaa2c384f12" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.220576] env[66834]: INFO networking_nsxv3.common.synchronization [req-7fb6d8a0-0362-4102-9de3-0680039e7276 req-631a5f04-88f7-4976-9c15-56b809e39a6b tempest-ImagesOneServerNegativeTestJSON-1609959325 tempest-ImagesOneServerNegativeTestJSON-1609959325-project-member] Enqueued Resource ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 with Priority: HIGHEST for action security_group_members [ 723.221200] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 with Priority: HIGHEST for action security_group_members [ 723.223430] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.223430] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.223430] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.223430] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.223430] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.223697] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.223697] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.223697] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.223775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.223863] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.682901] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-479 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.684020] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-479" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.684020] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-479" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.684141] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-479" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.684342] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.684498] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.685032] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.685377] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.685579] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.685882] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 723.687152] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 723.687152] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 723.687152] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 723.687152] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 723.687152] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 723.687152] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 723.713508] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 723.713777] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 723.713949] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 723.714362] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-479" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.714711] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-0e871f42-8f03-46e4-9731-cc428989bd9b taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.714934] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-0e871f42-8f03-46e4-9731-cc428989bd9b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.716543] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-0e871f42-8f03-46e4-9731-cc428989bd9b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.717056] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-0e871f42-8f03-46e4-9731-cc428989bd9b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.717185] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e871f42-8f03-46e4-9731-cc428989bd9b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.729711] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.729711] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.729711] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.730819] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.730819] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.730819] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.730819] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.730819] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.731112] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.731346] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.731346] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 is going to be updated. [ 723.750322] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4da628c-f2f0-417c-917f-a8cc4350870b in Status: SUCCESS [ 723.750659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.763895] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.764283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.764430] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.764786] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.765097] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.776236] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 in Status: IN_PROGRESS for 2s [ 723.787045] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: SUCCESS [ 723.787124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.787258] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.787473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.787663] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.787780] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.787844] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.788223] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.788223] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.788223] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.788363] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.789310] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.789479] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.790382] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.790382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.790382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.790382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.790382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.790382] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.220261] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.220460] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.220582] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.221036] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.221254] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.221359] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 0e871f42-8f03-46e4-9731-cc428989bd9b not found, creating... [ 724.221595] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.221746] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.221853] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.222090] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.222221] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.222493] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.222660] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.222770] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.222970] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.223201] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.223338] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 0e871f42-8f03-46e4-9731-cc428989bd9b is going to be created. [ 724.244682] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.244903] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.245031] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.245292] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.245515] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.245751] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-0e871f42-8f03-46e4-9731-cc428989bd9b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.292124] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.292303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.292459] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.795083] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.019268] env[66834]: INFO networking_nsxv3.common.synchronization [req-7fb6d8a0-0362-4102-9de3-0680039e7276 req-8a3e8612-be7b-4d19-909e-fcd5f397d424 service nova] Enqueued Resource ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 with Priority: HIGHEST for action security_group_rules [ 725.019553] env[66834]: INFO networking_nsxv3.common.synchronization [req-7fb6d8a0-0362-4102-9de3-0680039e7276 req-8a3e8612-be7b-4d19-909e-fcd5f397d424 service nova] Enqueued Resource ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 with Priority: HIGHEST for action security_group_members [ 725.019801] env[66834]: INFO networking_nsxv3.common.synchronization [req-7fb6d8a0-0362-4102-9de3-0680039e7276 req-8a3e8612-be7b-4d19-909e-fcd5f397d424 service nova] Enqueued Resource ID: 0e871f42-8f03-46e4-9731-cc428989bd9b with Priority: HIGHEST for action port [ 725.020851] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 with Priority: HIGHEST for action security_group_rules [ 725.020851] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 with Priority: HIGHEST for action security_group_members [ 725.020992] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e871f42-8f03-46e4-9731-cc428989bd9b with Priority: HIGHEST for action port [ 725.021302] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.021505] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.021626] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.021938] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.022232] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.023563] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.023707] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.023949] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e871f42-8f03-46e4-9731-cc428989bd9b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.024110] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e871f42-8f03-46e4-9731-cc428989bd9b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.024332] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e871f42-8f03-46e4-9731-cc428989bd9b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.025554] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e871f42-8f03-46e4-9731-cc428989bd9b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.025554] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e871f42-8f03-46e4-9731-cc428989bd9b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.297329] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.297444] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.298311] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.299123] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.299233] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.299334] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9276c5a5-af43-4c6e-899f-c34039400160 is going to be updated. [ 725.330305] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.330448] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.330515] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.330737] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.330888] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.342528] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: IN_PROGRESS for 2s [ 725.527392] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.527480] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.527747] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e871f42-8f03-46e4-9731-cc428989bd9b with status ACTIVE [ 725.528026] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.528193] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.528300] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.528706] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.528878] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.529145] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.529283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.529352] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.529619] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.529698] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.529887] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.529986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.531774] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.537017] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.537017] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.537017] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e871f42-8f03-46e4-9731-cc428989bd9b is going to be updated. [ 725.567692] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.568018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.568190] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.568691] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.568970] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.569371] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e871f42-8f03-46e4-9731-cc428989bd9b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.793013] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 in Status: SUCCESS [ 725.793013] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 deletion is rescheduled due to dependency. [ 725.793013] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.793013] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.793013] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.793013] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.793013] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.793013] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.793013] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.793431] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.793431] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.300870] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.805127] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.311804] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.311804] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.311804] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.312184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.312184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.312184] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 is going to be updated. [ 727.344870] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.345058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.345513] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.345658] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.348062] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.358584] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: SUCCESS [ 727.358754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.360666] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 in Status: IN_PROGRESS for 2s [ 727.361082] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.361082] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.361234] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.361353] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.361412] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.361801] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.361801] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.361801] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.867191] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.084583] env[66834]: INFO networking_nsxv3.common.synchronization [req-d4c790f3-7de4-47b6-ac2e-54dcd1a02d86 req-3acb10f3-3103-4c14-93a9-4cbe70972b2c tempest-ServersTestFqdnHostnames-454654824 tempest-ServersTestFqdnHostnames-454654824-project-member] Enqueued Resource ID: 3db0e155-352c-4d42-a24e-48fff17d86ac with Priority: HIGHEST for action security_group_members [ 728.085409] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3db0e155-352c-4d42-a24e-48fff17d86ac with Priority: HIGHEST for action security_group_members [ 728.085872] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3db0e155-352c-4d42-a24e-48fff17d86ac taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.086068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.086173] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.086561] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.086849] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.087048] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.087125] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.087344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.087472] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.087630] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3db0e155-352c-4d42-a24e-48fff17d86ac',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.370175] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.590574] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.590912] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.591015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.591302] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.591425] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.591654] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.591785] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.591864] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.592087] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.592186] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.592292] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3db0e155-352c-4d42-a24e-48fff17d86ac already deleted. [ 728.592403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.594661] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-964 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.594933] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-964" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.595157] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-964" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.595794] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-964" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.596220] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.596465] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.596608] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.596841] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.597477] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.597813] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.598011] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.598200] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.598392] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.598580] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.599213] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.599213] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.622560] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.622834] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 728.622974] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.623194] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-964" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.623563] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-08d728e8-57ca-4af1-b4b8-fbfb4e8929b7 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.623771] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-08d728e8-57ca-4af1-b4b8-fbfb4e8929b7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.623907] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-08d728e8-57ca-4af1-b4b8-fbfb4e8929b7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.624339] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-08d728e8-57ca-4af1-b4b8-fbfb4e8929b7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.624462] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08d728e8-57ca-4af1-b4b8-fbfb4e8929b7',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.872328] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.872493] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.872546] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.872804] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.872858] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.872940] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9276c5a5-af43-4c6e-899f-c34039400160 is going to be updated. [ 728.901581] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.901758] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.901816] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.902078] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.902274] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.911594] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: IN_PROGRESS for 2s [ 729.127106] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.127106] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.127106] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.127350] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.127397] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.127565] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 08d728e8-57ca-4af1-b4b8-fbfb4e8929b7 not found, creating... [ 729.127795] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.128091] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.128091] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.128441] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.128657] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.128974] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.129178] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.129314] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.129612] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.129727] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.129883] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 08d728e8-57ca-4af1-b4b8-fbfb4e8929b7 is going to be created. [ 729.160568] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.160824] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.161098] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.161440] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.161867] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.162238] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-08d728e8-57ca-4af1-b4b8-fbfb4e8929b7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.371611] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 in Status: SUCCESS [ 729.372115] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.372115] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.372380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.372600] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.372757] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.372821] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.372962] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.373068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.373236] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.373236] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.876620] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.876620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.876620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.876981] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.876981] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.877077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.877116] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.877726] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.877726] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.877726] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.877726] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.877726] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.877967] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.877967] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.878392] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.878392] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.878570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.878777] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.879020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.879020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.879165] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.880893] env[66834]: INFO networking_nsxv3.common.synchronization [req-d4c790f3-7de4-47b6-ac2e-54dcd1a02d86 req-4b90ae8d-85ff-49e6-845b-62953a72d87b service nova] Enqueued Resource ID: 3db0e155-352c-4d42-a24e-48fff17d86ac with Priority: HIGHEST for action security_group_rules [ 729.881158] env[66834]: INFO networking_nsxv3.common.synchronization [req-d4c790f3-7de4-47b6-ac2e-54dcd1a02d86 req-4b90ae8d-85ff-49e6-845b-62953a72d87b service nova] Enqueued Resource ID: 3db0e155-352c-4d42-a24e-48fff17d86ac with Priority: HIGHEST for action security_group_members [ 729.881331] env[66834]: INFO networking_nsxv3.common.synchronization [req-d4c790f3-7de4-47b6-ac2e-54dcd1a02d86 req-4b90ae8d-85ff-49e6-845b-62953a72d87b service nova] Enqueued Resource ID: 08d728e8-57ca-4af1-b4b8-fbfb4e8929b7 with Priority: HIGHEST for action port [ 729.882341] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3db0e155-352c-4d42-a24e-48fff17d86ac with Priority: HIGHEST for action security_group_rules [ 729.882341] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3db0e155-352c-4d42-a24e-48fff17d86ac with Priority: HIGHEST for action security_group_members [ 729.882341] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08d728e8-57ca-4af1-b4b8-fbfb4e8929b7 with Priority: HIGHEST for action port [ 729.882684] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3db0e155-352c-4d42-a24e-48fff17d86ac taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.882849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.882939] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.883166] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.883283] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3db0e155-352c-4d42-a24e-48fff17d86ac',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.885886] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3db0e155-352c-4d42-a24e-48fff17d86ac taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.886167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.886752] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.886752] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.886752] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.886752] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.887435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.888713] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.888713] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.888713] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3db0e155-352c-4d42-a24e-48fff17d86ac',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.888713] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-08d728e8-57ca-4af1-b4b8-fbfb4e8929b7 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.889034] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08d728e8-57ca-4af1-b4b8-fbfb4e8929b7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.889874] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08d728e8-57ca-4af1-b4b8-fbfb4e8929b7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.889874] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08d728e8-57ca-4af1-b4b8-fbfb4e8929b7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.890080] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08d728e8-57ca-4af1-b4b8-fbfb4e8929b7',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.383108] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4: rpc.has_security_group_logging(os_id): False [ 730.395858] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3db0e155-352c-4d42-a24e-48fff17d86ac taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.396034] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.396245] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3db0e155-352c-4d42-a24e-48fff17d86ac',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.399765] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08d728e8-57ca-4af1-b4b8-fbfb4e8929b7 with status ACTIVE [ 730.399765] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.399896] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.399954] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.400174] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.400251] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.400422] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.400524] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.400586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.400804] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.400804] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.401022] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.401123] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.401182] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.401316] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.401387] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.401468] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08d728e8-57ca-4af1-b4b8-fbfb4e8929b7 is going to be updated. [ 730.409025] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.409025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.409025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.409025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.409025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.409025] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.409025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.409025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.409025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.409025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.409025] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.409775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.409775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.409775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.409775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.409775] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.409775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.409775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.410053] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.410053] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.410053] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 is going to be updated. [ 730.439722] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.440162] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.440162] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.440268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.440322] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.440511] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08d728e8-57ca-4af1-b4b8-fbfb4e8929b7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.483018] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.483170] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.483242] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.483457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.483596] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.509645] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 in Status: IN_PROGRESS for 2s [ 730.678027] env[66834]: INFO networking_nsxv3.common.synchronization [None req-28530977-706f-4b6a-acb6-adf74cb6381b None None] Enqueued Resource ID: 2239fa6f-8b30-4c0c-9492-9a6e8c118295 with Priority: HIGHEST for action port [ 730.679535] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2239fa6f-8b30-4c0c-9492-9a6e8c118295 with Priority: HIGHEST for action port [ 730.680305] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-2239fa6f-8b30-4c0c-9492-9a6e8c118295 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.680305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2239fa6f-8b30-4c0c-9492-9a6e8c118295" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.680305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2239fa6f-8b30-4c0c-9492-9a6e8c118295" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.680517] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2239fa6f-8b30-4c0c-9492-9a6e8c118295" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.680651] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2239fa6f-8b30-4c0c-9492-9a6e8c118295',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.913967] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3db0e155-352c-4d42-a24e-48fff17d86ac',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.927061] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: SUCCESS [ 730.927061] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.927897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.927897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.927897] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.928106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.928106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.928378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.928566] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.928739] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.931745] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.931985] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.932227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.932525] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.932730] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.932904] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.932992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.933248] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.933473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.933612] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.933834] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.183579] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2239fa6f-8b30-4c0c-9492-9a6e8c118295 [ 731.184153] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.184153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.184416] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.184490] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.185173] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.185173] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2239fa6f-8b30-4c0c-9492-9a6e8c118295 already deleted. [ 731.185173] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2239fa6f-8b30-4c0c-9492-9a6e8c118295" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.417998] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.419132] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.419132] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.419132] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.419132] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.419132] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3db0e155-352c-4d42-a24e-48fff17d86ac is going to be created. [ 731.436298] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9276c5a5-af43-4c6e-899f-c34039400160: rpc.has_security_group_logging(os_id): False [ 731.446420] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.446580] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.446661] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.446879] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.447064] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.461117] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.461482] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.461866] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.462372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.462580] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.462994] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.463351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.463551] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.463940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.464534] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.464936] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.465121] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.465719] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.466667] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.466667] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.466667] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.466667] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.467078] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.467528] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.467590] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.467669] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9276c5a5-af43-4c6e-899f-c34039400160 is going to be created. [ 731.470096] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3db0e155-352c-4d42-a24e-48fff17d86ac in Status: UNINITIALIZED for 2s [ 731.559328] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.559328] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.559328] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.559328] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.559328] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.577328] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: IN_PROGRESS for 2s [ 732.528476] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 in Status: SUCCESS [ 732.528476] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.482027] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3db0e155-352c-4d42-a24e-48fff17d86ac in Status: SUCCESS [ 733.482255] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.482559] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.482666] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.482910] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.483044] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.483102] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.483238] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.483405] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.483630] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.483630] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3db0e155-352c-4d42-a24e-48fff17d86ac',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.592461] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: SUCCESS [ 733.593033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.593033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.593239] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.593360] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.987043] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3db0e155-352c-4d42-a24e-48fff17d86ac',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.097215] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.097215] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.097215] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.097215] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.097215] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.097215] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.097215] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.097849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.097849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.097849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.097849] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.150938] env[66834]: INFO networking_nsxv3.common.synchronization [None req-b03e6ba9-d8ac-46c1-978f-4314fed08ca6 None None] Enqueued Resource ID: c5031032-9076-47c5-a502-fed80fef79f3 with Priority: HIGHEST for action port [ 734.151761] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5031032-9076-47c5-a502-fed80fef79f3 with Priority: HIGHEST for action port [ 734.153041] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5031032-9076-47c5-a502-fed80fef79f3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.153041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5031032-9076-47c5-a502-fed80fef79f3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.153041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5031032-9076-47c5-a502-fed80fef79f3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.153041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5031032-9076-47c5-a502-fed80fef79f3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.153041] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5031032-9076-47c5-a502-fed80fef79f3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.490868] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3db0e155-352c-4d42-a24e-48fff17d86ac: rpc.has_security_group_logging(os_id): False [ 734.513210] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.513408] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.513408] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.514012] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.514012] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.514012] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.514173] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.514173] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.516412] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.516412] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.516412] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3db0e155-352c-4d42-a24e-48fff17d86ac is going to be created. [ 734.590761] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.591076] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.591130] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.591415] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.591815] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.602196] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.602196] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.602196] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.602677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.606028] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.606028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.606028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.606028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.606028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.606028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.606028] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.606028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.606028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.606028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.606028] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.606028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.606028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.606028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.606028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.606028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.606028] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.609918] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3db0e155-352c-4d42-a24e-48fff17d86ac in Status: IN_PROGRESS for 2s [ 734.656334] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5031032-9076-47c5-a502-fed80fef79f3 [ 734.656753] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.656948] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.657058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.657610] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.657822] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.657955] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5031032-9076-47c5-a502-fed80fef79f3 already deleted. [ 734.658216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5031032-9076-47c5-a502-fed80fef79f3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.108395] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9276c5a5-af43-4c6e-899f-c34039400160: rpc.has_security_group_logging(os_id): False [ 735.132993] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.132993] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.133185] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.133411] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.133580] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.133815] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.133937] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.134020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.134322] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.134457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.137351] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.137571] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.137700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.138015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.138173] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.138530] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.138805] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.138873] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.139077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.139174] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.139275] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9276c5a5-af43-4c6e-899f-c34039400160 is going to be updated. [ 735.214645] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.214941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.214941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.215175] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.215347] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.230348] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: IN_PROGRESS for 2s [ 736.637299] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3db0e155-352c-4d42-a24e-48fff17d86ac in Status: SUCCESS [ 736.637764] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.246133] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: SUCCESS [ 737.246406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.539649] env[66834]: INFO networking_nsxv3.common.synchronization [req-eacbe173-9154-4bcf-aa42-768c2cdd01e1 req-2e26957d-fe86-44d5-8954-ce6def94d7e3 tempest-FloatingIPsAssociationTestJSON-737304436 tempest-FloatingIPsAssociationTestJSON-737304436-project-member] Enqueued Resource ID: 01965726-b599-4a24-a0ef-beaaba998cf3 with Priority: HIGHEST for action security_group_members [ 738.540264] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01965726-b599-4a24-a0ef-beaaba998cf3 with Priority: HIGHEST for action security_group_members [ 738.540596] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-01965726-b599-4a24-a0ef-beaaba998cf3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.540734] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.540813] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.541279] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.541485] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.541633] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.541688] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.541842] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.541905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.541996] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01965726-b599-4a24-a0ef-beaaba998cf3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.046309] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.046309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.046309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.046309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.046309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.046641] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.046641] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.046807] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.046884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.047266] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.047266] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01965726-b599-4a24-a0ef-beaaba998cf3 is going to be updated. [ 739.082856] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.083199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.083285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.083852] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.083852] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.093997] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01965726-b599-4a24-a0ef-beaaba998cf3 in Status: IN_PROGRESS for 2s [ 740.259546] env[66834]: INFO networking_nsxv3.common.synchronization [req-ff511e82-7b49-4f08-bdad-07b66e32696b req-97822c0a-cf39-4acd-ba4c-17e11bf031f0 tempest-ServersTestManualDisk-242123046 tempest-ServersTestManualDisk-242123046-project-member] Enqueued Resource ID: b11bc7eb-c1bb-49d4-8347-38576752a094 with Priority: HIGHEST for action security_group_members [ 740.260203] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b11bc7eb-c1bb-49d4-8347-38576752a094 with Priority: HIGHEST for action security_group_members [ 740.260704] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-b11bc7eb-c1bb-49d4-8347-38576752a094 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.260836] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.260998] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.261619] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.262048] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.262048] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.262048] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.262319] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.262387] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.262442] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b11bc7eb-c1bb-49d4-8347-38576752a094',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.644379] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.644559] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-766" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.644671] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-766" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.644998] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-766" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.645280] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.645430] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.645512] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.645739] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.645899] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.646842] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.646975] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 740.647096] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 740.647198] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 740.647305] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.647398] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 740.647517] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 740.675968] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 740.676169] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 740.676321] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 740.677646] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-766" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.677956] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-b31c857e-183b-47d3-b58a-857e15ec4695 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.678159] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-b31c857e-183b-47d3-b58a-857e15ec4695" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.678311] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-b31c857e-183b-47d3-b58a-857e15ec4695" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.680524] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-b31c857e-183b-47d3-b58a-857e15ec4695" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.680524] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b31c857e-183b-47d3-b58a-857e15ec4695',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.766433] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.766433] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.766433] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.766433] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.766433] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.766433] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.766433] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.766433] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.766433] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.766433] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.766433] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b11bc7eb-c1bb-49d4-8347-38576752a094 already deleted. [ 740.766433] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.106205] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01965726-b599-4a24-a0ef-beaaba998cf3 in Status: SUCCESS [ 741.106328] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01965726-b599-4a24-a0ef-beaaba998cf3 deletion is rescheduled due to dependency. [ 741.106596] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.183136] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.183891] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.183891] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.183891] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.184385] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.184385] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port b31c857e-183b-47d3-b58a-857e15ec4695 not found, creating... [ 741.185029] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.185247] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.185699] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.189026] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.189026] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.189026] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.189026] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.189026] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.189026] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.189026] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.189026] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: b31c857e-183b-47d3-b58a-857e15ec4695 is going to be created. [ 741.216538] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.217078] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.217294] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.217634] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.217918] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.218185] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-b31c857e-183b-47d3-b58a-857e15ec4695" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.813464] env[66834]: INFO networking_nsxv3.common.synchronization [None req-b89ea6cc-94bf-450f-a4a7-58cc36dafda4 None None] Enqueued Resource ID: 7542b973-6e3d-4c46-a3db-f37fa8b37d37 with Priority: HIGHEST for action port [ 741.814192] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7542b973-6e3d-4c46-a3db-f37fa8b37d37 with Priority: HIGHEST for action port [ 741.814396] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-7542b973-6e3d-4c46-a3db-f37fa8b37d37 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.814396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7542b973-6e3d-4c46-a3db-f37fa8b37d37" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.814570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7542b973-6e3d-4c46-a3db-f37fa8b37d37" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.814701] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7542b973-6e3d-4c46-a3db-f37fa8b37d37" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.814782] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7542b973-6e3d-4c46-a3db-f37fa8b37d37',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.925757] env[66834]: INFO networking_nsxv3.common.synchronization [req-ff511e82-7b49-4f08-bdad-07b66e32696b req-92754322-671b-477e-a188-242a2f6f95ba service nova] Enqueued Resource ID: b11bc7eb-c1bb-49d4-8347-38576752a094 with Priority: HIGHEST for action security_group_rules [ 741.925757] env[66834]: INFO networking_nsxv3.common.synchronization [req-ff511e82-7b49-4f08-bdad-07b66e32696b req-92754322-671b-477e-a188-242a2f6f95ba service nova] Enqueued Resource ID: b11bc7eb-c1bb-49d4-8347-38576752a094 with Priority: HIGHEST for action security_group_members [ 741.925757] env[66834]: INFO networking_nsxv3.common.synchronization [req-ff511e82-7b49-4f08-bdad-07b66e32696b req-92754322-671b-477e-a188-242a2f6f95ba service nova] Enqueued Resource ID: b31c857e-183b-47d3-b58a-857e15ec4695 with Priority: HIGHEST for action port [ 741.926239] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b11bc7eb-c1bb-49d4-8347-38576752a094 with Priority: HIGHEST for action security_group_rules [ 741.927465] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b11bc7eb-c1bb-49d4-8347-38576752a094 with Priority: HIGHEST for action security_group_members [ 741.927821] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31c857e-183b-47d3-b58a-857e15ec4695 with Priority: HIGHEST for action port [ 741.930902] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b11bc7eb-c1bb-49d4-8347-38576752a094 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.930902] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.930902] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.930902] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.930902] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b11bc7eb-c1bb-49d4-8347-38576752a094',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.930902] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-b11bc7eb-c1bb-49d4-8347-38576752a094 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.930902] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.930902] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.932250] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.932673] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.934057] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.934057] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.934057] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.934057] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.934057] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b11bc7eb-c1bb-49d4-8347-38576752a094',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.935406] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-b31c857e-183b-47d3-b58a-857e15ec4695 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.935760] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b31c857e-183b-47d3-b58a-857e15ec4695" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.936127] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b31c857e-183b-47d3-b58a-857e15ec4695" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.936445] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b31c857e-183b-47d3-b58a-857e15ec4695" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.936574] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b31c857e-183b-47d3-b58a-857e15ec4695',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.318909] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7542b973-6e3d-4c46-a3db-f37fa8b37d37 [ 742.318909] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.318909] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.318909] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.318909] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.318909] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.318909] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7542b973-6e3d-4c46-a3db-f37fa8b37d37 already deleted. [ 742.318909] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7542b973-6e3d-4c46-a3db-f37fa8b37d37" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.441750] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-b11bc7eb-c1bb-49d4-8347-38576752a094 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.441750] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.441750] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b11bc7eb-c1bb-49d4-8347-38576752a094',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.441750] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b31c857e-183b-47d3-b58a-857e15ec4695 with status ACTIVE [ 742.441750] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.441750] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.441750] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.441750] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.441750] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.443118] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.443118] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.443118] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.443118] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.443118] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.443118] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.443118] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.443118] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.443118] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.443118] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.443118] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b31c857e-183b-47d3-b58a-857e15ec4695 is going to be updated. [ 742.472408] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.472408] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.472408] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.473118] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.473392] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.473468] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b31c857e-183b-47d3-b58a-857e15ec4695" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.698139] env[66834]: INFO networking_nsxv3.common.synchronization [req-11460c68-4258-43c9-aa52-c5fc411e349c req-e868a8ae-e8b3-4dde-9feb-6252e9a77d47 tempest-ServerRescueTestJSONUnderV235-1924768781 tempest-ServerRescueTestJSONUnderV235-1924768781-project-member] Enqueued Resource ID: a41415ed-2788-44fc-9776-a1eea5a113ed with Priority: HIGHEST for action security_group_members [ 742.698601] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a41415ed-2788-44fc-9776-a1eea5a113ed with Priority: HIGHEST for action security_group_members [ 742.698993] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a41415ed-2788-44fc-9776-a1eea5a113ed taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.701677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.701677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.701677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.701677] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.701941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.701941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.702028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.702627] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.702627] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a41415ed-2788-44fc-9776-a1eea5a113ed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.946878] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b11bc7eb-c1bb-49d4-8347-38576752a094',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.126699] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-861 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.126933] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-861" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.127079] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-861" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.127942] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-861" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.128013] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.128198] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.128312] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.128554] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.128821] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.129092] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 743.129211] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 743.129314] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 743.129417] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 743.129509] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 743.129610] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 743.129768] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 743.161128] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 743.161128] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 743.161128] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 743.161496] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-861" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.161691] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-06caac5c-6b6d-4b66-9e4c-5158725a8d18 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.161998] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-06caac5c-6b6d-4b66-9e4c-5158725a8d18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.161998] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-06caac5c-6b6d-4b66-9e4c-5158725a8d18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.162258] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-06caac5c-6b6d-4b66-9e4c-5158725a8d18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.162292] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06caac5c-6b6d-4b66-9e4c-5158725a8d18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.204721] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.204949] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.204949] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.205267] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.205267] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.205415] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.205508] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.205558] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.205701] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.205768] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.205861] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a41415ed-2788-44fc-9776-a1eea5a113ed already deleted. [ 743.205927] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.449099] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.449303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.449368] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.452033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.452033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.452033] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b11bc7eb-c1bb-49d4-8347-38576752a094 is going to be created. [ 743.478361] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.478361] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.478361] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.478361] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.478361] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.487304] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b11bc7eb-c1bb-49d4-8347-38576752a094 in Status: UNINITIALIZED for 2s [ 743.670103] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.670320] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.670486] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.670810] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.670992] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.671186] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 06caac5c-6b6d-4b66-9e4c-5158725a8d18 not found, creating... [ 743.671465] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.671675] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.671874] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.672090] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.673029] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.673029] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.673029] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.673029] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.673029] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.673304] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.673304] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 06caac5c-6b6d-4b66-9e4c-5158725a8d18 is going to be created. [ 743.707487] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.707709] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.707814] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.708087] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.708310] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.708531] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-06caac5c-6b6d-4b66-9e4c-5158725a8d18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.976242] env[66834]: INFO networking_nsxv3.common.synchronization [req-9e44995b-4bc4-4390-9090-e4a38124939a req-e7d9b0ad-b4fc-4a48-91da-57cf02864e47 tempest-ServersAdminNegativeTestJSON-1367226242 tempest-ServersAdminNegativeTestJSON-1367226242-project-member] Enqueued Resource ID: 06c1d39f-c76e-47c4-9900-046863c4e37a with Priority: HIGHEST for action security_group_members [ 743.976905] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06c1d39f-c76e-47c4-9900-046863c4e37a with Priority: HIGHEST for action security_group_members [ 743.977322] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06c1d39f-c76e-47c4-9900-046863c4e37a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.977751] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.977751] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.977925] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.978160] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.978335] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.978525] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.978774] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.978933] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.979082] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06c1d39f-c76e-47c4-9900-046863c4e37a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.391040] env[66834]: INFO networking_nsxv3.common.synchronization [req-11460c68-4258-43c9-aa52-c5fc411e349c req-302ae1af-f601-4d3a-beb4-579844a65282 service nova] Enqueued Resource ID: a41415ed-2788-44fc-9776-a1eea5a113ed with Priority: HIGHEST for action security_group_rules [ 744.391257] env[66834]: INFO networking_nsxv3.common.synchronization [req-11460c68-4258-43c9-aa52-c5fc411e349c req-302ae1af-f601-4d3a-beb4-579844a65282 service nova] Enqueued Resource ID: a41415ed-2788-44fc-9776-a1eea5a113ed with Priority: HIGHEST for action security_group_members [ 744.391358] env[66834]: INFO networking_nsxv3.common.synchronization [req-11460c68-4258-43c9-aa52-c5fc411e349c req-302ae1af-f601-4d3a-beb4-579844a65282 service nova] Enqueued Resource ID: 06caac5c-6b6d-4b66-9e4c-5158725a8d18 with Priority: HIGHEST for action port [ 744.391854] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a41415ed-2788-44fc-9776-a1eea5a113ed with Priority: HIGHEST for action security_group_rules [ 744.391988] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a41415ed-2788-44fc-9776-a1eea5a113ed with Priority: HIGHEST for action security_group_members [ 744.392927] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06caac5c-6b6d-4b66-9e4c-5158725a8d18 with Priority: HIGHEST for action port [ 744.393260] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a41415ed-2788-44fc-9776-a1eea5a113ed taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.393445] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.393549] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.394638] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.394638] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a41415ed-2788-44fc-9776-a1eea5a113ed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.396419] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a41415ed-2788-44fc-9776-a1eea5a113ed taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.396721] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.397384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.397858] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.398222] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.398445] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.399373] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.399417] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.399591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.399717] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a41415ed-2788-44fc-9776-a1eea5a113ed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.401838] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-06caac5c-6b6d-4b66-9e4c-5158725a8d18 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.401838] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06caac5c-6b6d-4b66-9e4c-5158725a8d18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.401838] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06caac5c-6b6d-4b66-9e4c-5158725a8d18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.401838] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06caac5c-6b6d-4b66-9e4c-5158725a8d18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.401838] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06caac5c-6b6d-4b66-9e4c-5158725a8d18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.482278] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06c1d39f-c76e-47c4-9900-046863c4e37a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.557410] env[66834]: INFO networking_nsxv3.common.synchronization [None req-d47f4d0a-57bf-4acb-b160-47e9016d5651 None None] Enqueued Resource ID: fcf5e62d-e06a-4613-90b2-d961f547d91c with Priority: HIGHEST for action port [ 744.558046] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcf5e62d-e06a-4613-90b2-d961f547d91c with Priority: HIGHEST for action port [ 744.558348] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcf5e62d-e06a-4613-90b2-d961f547d91c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.558518] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcf5e62d-e06a-4613-90b2-d961f547d91c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.558571] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcf5e62d-e06a-4613-90b2-d961f547d91c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.558875] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcf5e62d-e06a-4613-90b2-d961f547d91c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.558956] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcf5e62d-e06a-4613-90b2-d961f547d91c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.903280] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a41415ed-2788-44fc-9776-a1eea5a113ed taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.903280] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.904246] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a41415ed-2788-44fc-9776-a1eea5a113ed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.904650] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 06caac5c-6b6d-4b66-9e4c-5158725a8d18 with status ACTIVE [ 744.905352] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.905527] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.905743] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.906661] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.906661] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.906661] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.906661] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.906824] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.907015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.907161] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.907442] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.907622] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.907700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.908080] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.908080] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.908205] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 06caac5c-6b6d-4b66-9e4c-5158725a8d18 is going to be updated. [ 744.933555] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.933555] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.933555] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.934094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.934094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.934253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06caac5c-6b6d-4b66-9e4c-5158725a8d18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.984334] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06c1d39f-c76e-47c4-9900-046863c4e37a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.063834] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fcf5e62d-e06a-4613-90b2-d961f547d91c [ 745.063834] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.063834] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.063834] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.063834] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.063834] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.063834] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fcf5e62d-e06a-4613-90b2-d961f547d91c already deleted. [ 745.063834] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcf5e62d-e06a-4613-90b2-d961f547d91c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.411589] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a41415ed-2788-44fc-9776-a1eea5a113ed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.443282] env[66834]: INFO networking_nsxv3.common.synchronization [req-9ada5648-ce77-48b1-9728-7af83f25bdc2 req-4e72127d-35ea-4865-9ec2-818d54b441a8 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 745.443282] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 745.443282] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.443282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.443282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.443282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.443282] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.443282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.443282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.443282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.443282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.443980] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.490436] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.490579] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.490689] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.490846] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.490942] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.491068] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06c1d39f-c76e-47c4-9900-046863c4e37a is going to be updated. [ 745.502417] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b11bc7eb-c1bb-49d4-8347-38576752a094 in Status: SUCCESS [ 745.502417] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.502417] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.503376] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.503376] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.503376] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.503376] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.503637] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.503637] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.504636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.504636] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b11bc7eb-c1bb-49d4-8347-38576752a094',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.523700] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.523849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.523922] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.524160] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.524310] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.535642] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06c1d39f-c76e-47c4-9900-046863c4e37a in Status: IN_PROGRESS for 2s [ 745.896861] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-403 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.897052] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-403" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.897163] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-403" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.897440] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-403" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.897780] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.898533] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.898697] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.898914] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.899088] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.899298] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.899414] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.899517] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.899617] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.899756] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.899867] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.899993] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.913837] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.914024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.914103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.914298] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.914389] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.914484] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a41415ed-2788-44fc-9776-a1eea5a113ed is going to be created. [ 745.919916] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.920064] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 745.920205] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.920343] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-403" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.920658] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-d7d14587-9c33-4f63-bdfa-4032543cd8b0 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.920799] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-d7d14587-9c33-4f63-bdfa-4032543cd8b0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.920912] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-d7d14587-9c33-4f63-bdfa-4032543cd8b0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.921273] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-d7d14587-9c33-4f63-bdfa-4032543cd8b0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.922197] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7d14587-9c33-4f63-bdfa-4032543cd8b0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.942664] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.942865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.942865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.943254] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.943254] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.946960] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.954545] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a41415ed-2788-44fc-9776-a1eea5a113ed in Status: UNINITIALIZED for 2s [ 746.009109] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b11bc7eb-c1bb-49d4-8347-38576752a094',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.423397] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.423621] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.423742] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.424043] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.424192] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.424339] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port d7d14587-9c33-4f63-bdfa-4032543cd8b0 not found, creating... [ 746.424588] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.424751] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.424862] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.425085] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.425223] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.425488] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.425637] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.425747] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.425995] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.426089] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.426210] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: d7d14587-9c33-4f63-bdfa-4032543cd8b0 is going to be created. [ 746.447021] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.447021] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.447214] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.447376] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.447593] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.447811] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-d7d14587-9c33-4f63-bdfa-4032543cd8b0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.449429] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.511863] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b11bc7eb-c1bb-49d4-8347-38576752a094: rpc.has_security_group_logging(os_id): False [ 746.537257] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.537407] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.537549] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.537799] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.537920] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.538180] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.538287] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.538360] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.538502] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.538579] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.538833] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b11bc7eb-c1bb-49d4-8347-38576752a094 is going to be created. [ 746.638271] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.638605] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.638605] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.638772] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.638948] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.656564] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b11bc7eb-c1bb-49d4-8347-38576752a094 in Status: IN_PROGRESS for 2s [ 746.950932] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.951156] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.951243] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.951506] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.951623] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.951758] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21deb826-26b5-4246-96bf-34da6682babd is going to be updated. [ 746.984512] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.984699] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.984802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.985013] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.985233] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.997785] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: IN_PROGRESS for 2s [ 747.245424] env[66834]: INFO networking_nsxv3.common.synchronization [req-9ada5648-ce77-48b1-9728-7af83f25bdc2 req-5b6eaafd-45d2-48eb-aea5-0d8e8824232c service nova] Enqueued Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_rules [ 747.245768] env[66834]: INFO networking_nsxv3.common.synchronization [req-9ada5648-ce77-48b1-9728-7af83f25bdc2 req-5b6eaafd-45d2-48eb-aea5-0d8e8824232c service nova] Enqueued Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 747.245768] env[66834]: INFO networking_nsxv3.common.synchronization [req-9ada5648-ce77-48b1-9728-7af83f25bdc2 req-5b6eaafd-45d2-48eb-aea5-0d8e8824232c service nova] Enqueued Resource ID: d7d14587-9c33-4f63-bdfa-4032543cd8b0 with Priority: HIGHEST for action port [ 747.246281] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_rules [ 747.246417] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 747.246510] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d14587-9c33-4f63-bdfa-4032543cd8b0 with Priority: HIGHEST for action port [ 747.247423] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.247423] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.247423] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.247423] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.247423] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.248386] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.249032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.249032] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7d14587-9c33-4f63-bdfa-4032543cd8b0 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.249032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7d14587-9c33-4f63-bdfa-4032543cd8b0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.249032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7d14587-9c33-4f63-bdfa-4032543cd8b0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.249370] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7d14587-9c33-4f63-bdfa-4032543cd8b0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.249430] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7d14587-9c33-4f63-bdfa-4032543cd8b0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.548356] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06c1d39f-c76e-47c4-9900-046863c4e37a in Status: SUCCESS [ 747.548356] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.632549] env[66834]: INFO networking_nsxv3.common.synchronization [None req-9b2fb333-1e8c-44ea-abf9-dc59adaa64c0 None None] Enqueued Resource ID: 8337ea9d-b3c2-475b-88bb-fb1993cb9a0a with Priority: HIGHEST for action port [ 747.633246] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8337ea9d-b3c2-475b-88bb-fb1993cb9a0a with Priority: HIGHEST for action port [ 747.633576] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-8337ea9d-b3c2-475b-88bb-fb1993cb9a0a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.634044] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8337ea9d-b3c2-475b-88bb-fb1993cb9a0a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.634044] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8337ea9d-b3c2-475b-88bb-fb1993cb9a0a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.634164] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8337ea9d-b3c2-475b-88bb-fb1993cb9a0a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.634240] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8337ea9d-b3c2-475b-88bb-fb1993cb9a0a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.751615] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.751759] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.751889] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7d14587-9c33-4f63-bdfa-4032543cd8b0 with status ACTIVE [ 747.752069] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.752185] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.752278] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.752585] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.752708] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.753824] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.753941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.754016] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.754262] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.754351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.754544] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.754643] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.754723] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.754855] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.754932] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.755026] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7d14587-9c33-4f63-bdfa-4032543cd8b0 is going to be updated. [ 747.784155] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.784293] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.784355] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.785331] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.785331] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.785331] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7d14587-9c33-4f63-bdfa-4032543cd8b0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.968253] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a41415ed-2788-44fc-9776-a1eea5a113ed in Status: SUCCESS [ 747.968480] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.968652] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.968991] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.969429] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.969429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.969429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.969571] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.969626] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.969749] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.969848] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a41415ed-2788-44fc-9776-a1eea5a113ed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.137839] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8337ea9d-b3c2-475b-88bb-fb1993cb9a0a [ 748.138741] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.138741] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.138741] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.138741] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.138741] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.138741] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8337ea9d-b3c2-475b-88bb-fb1993cb9a0a already deleted. [ 748.138741] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8337ea9d-b3c2-475b-88bb-fb1993cb9a0a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.472524] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a41415ed-2788-44fc-9776-a1eea5a113ed taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.478019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.478019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.478019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.478019] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.478019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.478019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.478019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.478019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.478019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.478019] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a41415ed-2788-44fc-9776-a1eea5a113ed taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.478019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.478019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.478019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.478019] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.478019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.478019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.478019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.478019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.478903] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.478903] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a41415ed-2788-44fc-9776-a1eea5a113ed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.676276] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b11bc7eb-c1bb-49d4-8347-38576752a094 in Status: SUCCESS [ 748.676630] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.980403] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a41415ed-2788-44fc-9776-a1eea5a113ed: rpc.has_security_group_logging(os_id): False [ 749.000257] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.000409] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.000460] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.000868] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.000868] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.001031] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.001125] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.001172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.001339] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.001396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.001589] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.001686] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.001757] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.001902] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.002013] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.002604] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.002706] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.002782] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.002932] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.003041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.003133] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a41415ed-2788-44fc-9776-a1eea5a113ed is going to be created. [ 749.023199] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: SUCCESS [ 749.023199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.023199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.023199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.023199] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.023199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.023199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.023199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.023199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.023199] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.070433] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.074022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.074022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.074022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.074022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.091460] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a41415ed-2788-44fc-9776-a1eea5a113ed in Status: IN_PROGRESS for 2s [ 749.527132] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.029644] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.042680] env[66834]: INFO networking_nsxv3.common.synchronization [req-d869f772-1157-4619-85f4-a7b1fc1fccb5 req-47fe6cdd-8c73-4f4b-bd5a-b1d05cce116c tempest-ServerTagsTestJSON-2062520612 tempest-ServerTagsTestJSON-2062520612-project-member] Enqueued Resource ID: a4da628c-f2f0-417c-917f-a8cc4350870b with Priority: HIGHEST for action security_group_members [ 750.043222] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4da628c-f2f0-417c-917f-a8cc4350870b with Priority: HIGHEST for action security_group_members [ 750.043530] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4da628c-f2f0-417c-917f-a8cc4350870b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.043651] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.043719] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.043911] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.044669] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.044790] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.045224] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.045224] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.045224] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.045224] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4da628c-f2f0-417c-917f-a8cc4350870b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.262326] env[66834]: INFO networking_nsxv3.common.synchronization [req-cad611d9-9223-4a00-bf5e-0ccc30b9a6b3 req-8a3e7670-2a6b-4627-bd9f-4af48ea70514 tempest-ImagesOneServerNegativeTestJSON-1609959325 tempest-ImagesOneServerNegativeTestJSON-1609959325-project-member] Enqueued Resource ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 with Priority: HIGHEST for action security_group_members [ 750.262326] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 with Priority: HIGHEST for action security_group_members [ 750.262706] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.262902] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.263018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.263312] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.263545] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.263690] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.263795] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.264067] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.264201] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.264407] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.334162] env[66834]: INFO networking_nsxv3.common.synchronization [req-f4cbb92f-ddf7-4052-bcbc-28365550b130 req-0e0c684e-7031-40e0-a9c1-a7208621cc17 tempest-ImagesTestJSON-910661197 tempest-ImagesTestJSON-910661197-project-member] Enqueued Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 750.334162] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 750.334162] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.334955] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.335141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.335440] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.335706] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.335936] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.336163] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.336413] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.337631] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.337920] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.388809] env[66834]: INFO networking_nsxv3.common.synchronization [None req-9f4d9d85-be54-40bd-93de-d00984e1f017 None None] Enqueued Resource ID: 6fe22cb4-1c54-4ff6-8ea6-1328369ed463 with Priority: HIGHEST for action port [ 750.394150] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe22cb4-1c54-4ff6-8ea6-1328369ed463 with Priority: HIGHEST for action port [ 750.394504] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fe22cb4-1c54-4ff6-8ea6-1328369ed463 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.394504] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fe22cb4-1c54-4ff6-8ea6-1328369ed463" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.394504] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fe22cb4-1c54-4ff6-8ea6-1328369ed463" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.394828] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fe22cb4-1c54-4ff6-8ea6-1328369ed463" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.394936] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fe22cb4-1c54-4ff6-8ea6-1328369ed463',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.531575] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.531975] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.531975] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.532681] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.532681] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.532681] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21deb826-26b5-4246-96bf-34da6682babd is going to be updated. [ 750.549275] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.549570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.549702] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.550300] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.550478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.550757] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.551730] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.551730] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.551959] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.552087] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.552642] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4da628c-f2f0-417c-917f-a8cc4350870b is going to be updated. [ 750.583069] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.583069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.583300] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.583504] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.584599] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.599688] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: IN_PROGRESS for 2s [ 750.602274] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.602274] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.602274] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.602846] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.602933] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.617623] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4da628c-f2f0-417c-917f-a8cc4350870b in Status: IN_PROGRESS for 2s [ 750.775029] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.775029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.775029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.775029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.775029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.775029] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.775029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.775029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.775029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.775029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.775029] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 is going to be updated. [ 750.813661] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.813661] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.813661] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.813661] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.813661] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.826363] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 in Status: IN_PROGRESS for 2s [ 750.845266] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.845454] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.845526] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.845744] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.845836] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.846070] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.846179] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.846242] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.846399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.846477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.846562] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 is going to be updated. [ 750.893249] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.893249] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.893249] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.893741] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.893898] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.897063] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6fe22cb4-1c54-4ff6-8ea6-1328369ed463 [ 750.897063] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.897199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.897199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.897429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.897517] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.897609] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6fe22cb4-1c54-4ff6-8ea6-1328369ed463 already deleted. [ 750.897716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fe22cb4-1c54-4ff6-8ea6-1328369ed463" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.904312] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: IN_PROGRESS for 2s [ 751.108987] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a41415ed-2788-44fc-9776-a1eea5a113ed in Status: SUCCESS [ 751.108987] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.610311] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: SUCCESS [ 752.610589] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.610832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.610913] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.611125] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.611272] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.611323] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.611465] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.611545] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.611628] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.611719] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.627132] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4da628c-f2f0-417c-917f-a8cc4350870b in Status: SUCCESS [ 752.627309] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4da628c-f2f0-417c-917f-a8cc4350870b deletion is rescheduled due to dependency. [ 752.627468] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.815731] env[66834]: INFO networking_nsxv3.common.synchronization [req-bef73b8a-a576-4c2d-a335-408ac216ddd0 req-429c6109-e281-4eb3-a30f-6eec89e40bec tempest-ServerDiskConfigTestJSON-362503924 tempest-ServerDiskConfigTestJSON-362503924-project-member] Enqueued Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 752.816327] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 752.816628] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.816743] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.816809] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.817071] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.817218] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.817409] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.817409] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.817536] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.817643] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.818036] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.837428] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 in Status: SUCCESS [ 752.837650] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 deletion is rescheduled due to dependency. [ 752.837715] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.918591] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: SUCCESS [ 752.918591] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 deletion is rescheduled due to dependency. [ 752.918591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.114391] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.114565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.116055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.116055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.116055] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.116055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.116055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.116055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.116055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.116055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.116055] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.116055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.116055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.116055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.116751] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.116751] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.116751] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.116751] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.116751] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.116751] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.117024] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.306932] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-98 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.306932] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-98" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.306932] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-98" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.306932] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-98" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.306932] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.307526] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.307819] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.310916] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.310916] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.310916] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 753.310916] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 753.310916] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 753.310916] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 753.310916] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 753.310916] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 753.310916] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 753.321027] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.321027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.321027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.321027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.321027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.321027] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.321027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.321027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.321027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.321027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.321504] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7963c125-23b5-45fd-8158-f6470d12949e is going to be updated. [ 753.331400] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 753.331809] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 753.331982] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 753.332202] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-98" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.332539] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-d6351a3a-52cf-4eb0-8bf4-435fa8c2f437 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.332751] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-d6351a3a-52cf-4eb0-8bf4-435fa8c2f437" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.332872] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-d6351a3a-52cf-4eb0-8bf4-435fa8c2f437" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.333231] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-d6351a3a-52cf-4eb0-8bf4-435fa8c2f437" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.333374] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6351a3a-52cf-4eb0-8bf4-435fa8c2f437',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.349636] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.349766] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.350575] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.350575] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.350575] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.364066] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: IN_PROGRESS for 2s [ 753.622667] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21deb826-26b5-4246-96bf-34da6682babd: rpc.has_security_group_logging(os_id): False [ 753.643741] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.643939] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.644078] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.644348] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.644477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.644747] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.644885] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.645021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.645241] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.645421] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.645608] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.645722] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.645776] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.645911] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.645996] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.646275] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.646416] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.646506] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.646706] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.646818] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.646937] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21deb826-26b5-4246-96bf-34da6682babd is going to be updated. [ 753.737607] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.737607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.737607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.737607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.737607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.763396] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: IN_PROGRESS for 2s [ 753.836408] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.839024] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.839024] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.839024] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.839024] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.839024] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port d6351a3a-52cf-4eb0-8bf4-435fa8c2f437 not found, creating... [ 753.839024] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.839024] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.839024] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.839024] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.839024] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.839494] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.839696] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.839929] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.840301] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.840546] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.840784] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: d6351a3a-52cf-4eb0-8bf4-435fa8c2f437 is going to be created. [ 753.871105] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.871105] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.871105] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.871105] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.871105] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.871833] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-d6351a3a-52cf-4eb0-8bf4-435fa8c2f437" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.589565] env[66834]: INFO networking_nsxv3.common.synchronization [req-bef73b8a-a576-4c2d-a335-408ac216ddd0 req-191bc9ac-5de1-43c0-94ee-40393421aea6 service nova] Enqueued Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_rules [ 754.589818] env[66834]: INFO networking_nsxv3.common.synchronization [req-bef73b8a-a576-4c2d-a335-408ac216ddd0 req-191bc9ac-5de1-43c0-94ee-40393421aea6 service nova] Enqueued Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 754.590782] env[66834]: INFO networking_nsxv3.common.synchronization [req-bef73b8a-a576-4c2d-a335-408ac216ddd0 req-191bc9ac-5de1-43c0-94ee-40393421aea6 service nova] Enqueued Resource ID: d6351a3a-52cf-4eb0-8bf4-435fa8c2f437 with Priority: HIGHEST for action port [ 754.591817] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_rules [ 754.592037] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 754.592199] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6351a3a-52cf-4eb0-8bf4-435fa8c2f437 with Priority: HIGHEST for action port [ 754.593022] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.593309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.594365] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.595161] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.595161] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.597877] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.597877] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.598056] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6351a3a-52cf-4eb0-8bf4-435fa8c2f437 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.598192] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6351a3a-52cf-4eb0-8bf4-435fa8c2f437" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.598274] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6351a3a-52cf-4eb0-8bf4-435fa8c2f437" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.598675] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6351a3a-52cf-4eb0-8bf4-435fa8c2f437" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.598794] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6351a3a-52cf-4eb0-8bf4-435fa8c2f437',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.101315] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.101660] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.101660] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6351a3a-52cf-4eb0-8bf4-435fa8c2f437 with status ACTIVE [ 755.102401] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.102401] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.102401] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.102401] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.102401] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.102713] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.102713] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.102713] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.102808] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.102840] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.103509] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.103509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.103509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.103509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.103509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.103509] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6351a3a-52cf-4eb0-8bf4-435fa8c2f437 is going to be updated. [ 755.126884] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.126884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.126884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.126884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.126884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.126884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6351a3a-52cf-4eb0-8bf4-435fa8c2f437" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.374123] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: SUCCESS [ 755.374361] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7963c125-23b5-45fd-8158-f6470d12949e deletion is rescheduled due to dependency. [ 755.374539] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.374803] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.375091] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.375332] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.375489] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.375542] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.375787] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.375934] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.376224] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.592621] env[66834]: INFO networking_nsxv3.common.synchronization [req-de27a07c-a871-41bf-94c2-eae54bd75ff0 req-f4511e69-7d8d-4b76-afb3-09dec12dd7a6 tempest-AttachInterfacesTestJSON-77868371 tempest-AttachInterfacesTestJSON-77868371-project-member] Enqueued Resource ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 with Priority: HIGHEST for action security_group_members [ 755.593391] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 with Priority: HIGHEST for action security_group_members [ 755.593520] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b0294dc-2245-46bf-a56e-f22fbf616a62 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.593639] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.594430] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.594430] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.594430] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.594430] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.594430] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.594430] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.594750] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.594750] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b0294dc-2245-46bf-a56e-f22fbf616a62',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.782783] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: SUCCESS [ 755.782783] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.881772] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.965961] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-106 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.966271] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.966397] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.966925] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.967340] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.967522] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.967522] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.967745] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.967890] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.968163] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 755.968435] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 755.968565] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 755.968776] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 755.968925] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 755.969128] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 755.969288] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 755.993785] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 755.993993] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 755.994143] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 755.994372] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.994817] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-911dd3b6-376c-4557-9b50-9c74fa3006d7 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.995035] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-911dd3b6-376c-4557-9b50-9c74fa3006d7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.995163] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-911dd3b6-376c-4557-9b50-9c74fa3006d7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.995486] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-911dd3b6-376c-4557-9b50-9c74fa3006d7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.995621] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('911dd3b6-376c-4557-9b50-9c74fa3006d7',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.096749] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.096976] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.097071] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.097318] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.097446] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.097668] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.097865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.097953] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.098135] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.098215] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.098296] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 already deleted. [ 756.098377] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.385666] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.498382] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.498599] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.498721] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.499084] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.499223] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.499406] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 911dd3b6-376c-4557-9b50-9c74fa3006d7 not found, creating... [ 756.499678] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.499880] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.499998] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.500182] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.500309] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.500607] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.500837] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.501152] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.501439] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.501579] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.501716] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 911dd3b6-376c-4557-9b50-9c74fa3006d7 is going to be created. [ 756.520628] env[66834]: INFO networking_nsxv3.common.synchronization [req-165ef7e7-f2d9-4499-8e96-5eed1253b051 req-f80e680a-4281-49a0-9410-c33fd5af9c32 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 with Priority: HIGHEST for action security_group_members [ 756.520812] env[66834]: INFO networking_nsxv3.common.synchronization [req-165ef7e7-f2d9-4499-8e96-5eed1253b051 req-f80e680a-4281-49a0-9410-c33fd5af9c32 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 756.522446] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 with Priority: HIGHEST for action security_group_members [ 756.522543] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 756.522834] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-782e10e2-c275-4c7b-bb67-ec47dc30cf73 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.522958] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.523043] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.523307] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.523474] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.523582] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.523645] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.523798] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.523885] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.523977] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('782e10e2-c275-4c7b-bb67-ec47dc30cf73',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.525410] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.525514] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.525587] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.525750] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.525896] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.525994] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.526071] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.526762] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.526762] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.526762] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.543507] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.543507] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.543723] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.544849] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.544849] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.544849] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-911dd3b6-376c-4557-9b50-9c74fa3006d7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.580523] env[66834]: INFO networking_nsxv3.common.synchronization [req-165ef7e7-f2d9-4499-8e96-5eed1253b051 req-f80e680a-4281-49a0-9410-c33fd5af9c32 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_rules [ 756.580743] env[66834]: INFO networking_nsxv3.common.synchronization [req-165ef7e7-f2d9-4499-8e96-5eed1253b051 req-f80e680a-4281-49a0-9410-c33fd5af9c32 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 756.580920] env[66834]: INFO networking_nsxv3.common.synchronization [req-165ef7e7-f2d9-4499-8e96-5eed1253b051 req-f80e680a-4281-49a0-9410-c33fd5af9c32 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 with Priority: HIGHEST for action security_group_rules [ 756.581284] env[66834]: INFO networking_nsxv3.common.synchronization [req-165ef7e7-f2d9-4499-8e96-5eed1253b051 req-f80e680a-4281-49a0-9410-c33fd5af9c32 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 with Priority: HIGHEST for action security_group_members [ 756.581436] env[66834]: INFO networking_nsxv3.common.synchronization [req-165ef7e7-f2d9-4499-8e96-5eed1253b051 req-f80e680a-4281-49a0-9410-c33fd5af9c32 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: d7d14587-9c33-4f63-bdfa-4032543cd8b0 with Priority: HIGHEST for action port [ 756.582196] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_rules [ 756.582393] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 with Priority: HIGHEST for action security_group_rules [ 756.582511] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d14587-9c33-4f63-bdfa-4032543cd8b0 with Priority: HIGHEST for action port [ 756.582635] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 756.582793] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 with Priority: HIGHEST for action security_group_members [ 756.583543] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.583543] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.583543] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.583725] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.583725] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.585920] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-782e10e2-c275-4c7b-bb67-ec47dc30cf73 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.585920] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.585920] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.585920] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.585920] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('782e10e2-c275-4c7b-bb67-ec47dc30cf73',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.586906] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7d14587-9c33-4f63-bdfa-4032543cd8b0 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.587064] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7d14587-9c33-4f63-bdfa-4032543cd8b0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.587149] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7d14587-9c33-4f63-bdfa-4032543cd8b0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.587358] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7d14587-9c33-4f63-bdfa-4032543cd8b0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.587453] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7d14587-9c33-4f63-bdfa-4032543cd8b0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.591024] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.591024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.591024] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-782e10e2-c275-4c7b-bb67-ec47dc30cf73 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.591024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.890036] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.890036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.890036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.890036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.890036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.890036] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7963c125-23b5-45fd-8158-f6470d12949e is going to be updated. [ 756.922726] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.922726] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.922726] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.923070] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.923070] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.933596] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: IN_PROGRESS for 2s [ 757.028188] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('782e10e2-c275-4c7b-bb67-ec47dc30cf73',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.029401] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.092658] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.092838] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.093126] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-782e10e2-c275-4c7b-bb67-ec47dc30cf73 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.093266] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.093364] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7d14587-9c33-4f63-bdfa-4032543cd8b0 with status ACTIVE [ 757.093592] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.093732] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.093799] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.093996] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.094121] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.094294] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.094429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.094466] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.094679] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.094748] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.094950] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.095082] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.095137] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.095269] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.095341] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.095409] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7d14587-9c33-4f63-bdfa-4032543cd8b0 is going to be updated. [ 757.120636] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.120837] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.120877] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.121112] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.121539] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.121539] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7d14587-9c33-4f63-bdfa-4032543cd8b0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.279249] env[66834]: INFO networking_nsxv3.common.synchronization [req-de27a07c-a871-41bf-94c2-eae54bd75ff0 req-78f604da-af8e-489a-9867-874ee7462204 service nova] Enqueued Resource ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 with Priority: HIGHEST for action security_group_rules [ 757.279249] env[66834]: INFO networking_nsxv3.common.synchronization [req-de27a07c-a871-41bf-94c2-eae54bd75ff0 req-78f604da-af8e-489a-9867-874ee7462204 service nova] Enqueued Resource ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 with Priority: HIGHEST for action security_group_members [ 757.279249] env[66834]: INFO networking_nsxv3.common.synchronization [req-de27a07c-a871-41bf-94c2-eae54bd75ff0 req-78f604da-af8e-489a-9867-874ee7462204 service nova] Enqueued Resource ID: 911dd3b6-376c-4557-9b50-9c74fa3006d7 with Priority: HIGHEST for action port [ 757.279249] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 with Priority: HIGHEST for action security_group_rules [ 757.279249] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 with Priority: HIGHEST for action security_group_members [ 757.279249] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 911dd3b6-376c-4557-9b50-9c74fa3006d7 with Priority: HIGHEST for action port [ 757.279249] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b0294dc-2245-46bf-a56e-f22fbf616a62 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.279249] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.279249] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.279249] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.279249] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b0294dc-2245-46bf-a56e-f22fbf616a62',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.281018] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b0294dc-2245-46bf-a56e-f22fbf616a62 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.281174] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.281232] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.282261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.282261] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.282261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.282261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.282261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.282261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.282261] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b0294dc-2245-46bf-a56e-f22fbf616a62',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.284306] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-911dd3b6-376c-4557-9b50-9c74fa3006d7 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.285039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-911dd3b6-376c-4557-9b50-9c74fa3006d7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.285097] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-911dd3b6-376c-4557-9b50-9c74fa3006d7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.285256] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-911dd3b6-376c-4557-9b50-9c74fa3006d7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.285337] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('911dd3b6-376c-4557-9b50-9c74fa3006d7',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.530808] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('782e10e2-c275-4c7b-bb67-ec47dc30cf73',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.531880] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.785396] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b0294dc-2245-46bf-a56e-f22fbf616a62',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.789709] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b0294dc-2245-46bf-a56e-f22fbf616a62 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.789709] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.789709] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 911dd3b6-376c-4557-9b50-9c74fa3006d7 with status ACTIVE [ 757.789709] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.789709] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.789709] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.790199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.790199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.790326] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.790326] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.790406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.790575] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.790741] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.791086] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.791755] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.791755] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.791922] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.792044] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.792156] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 911dd3b6-376c-4557-9b50-9c74fa3006d7 is going to be updated. [ 757.815320] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.815320] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.815546] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.815546] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.815679] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.816393] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-911dd3b6-376c-4557-9b50-9c74fa3006d7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.034498] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.035722] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.035825] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.036064] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.036168] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.036274] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 is going to be created. [ 758.037837] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.037837] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.037837] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.038054] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.038054] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.038129] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21deb826-26b5-4246-96bf-34da6682babd is going to be updated. [ 758.074463] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.074463] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.074463] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.074681] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.075471] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.079038] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.079038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.079038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.079038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.079038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.088886] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: IN_PROGRESS for 2s [ 758.089651] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 in Status: UNINITIALIZED for 2s [ 758.287343] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b0294dc-2245-46bf-a56e-f22fbf616a62',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.301650] env[66834]: INFO networking_nsxv3.common.synchronization [req-105c3adb-f887-4ce1-992c-8e2f01c07c45 req-7bff4d0f-46a4-4315-82d0-96ce5e9d9d92 tempest-ServersTestJSON-2040502537 tempest-ServersTestJSON-2040502537-project-member] Enqueued Resource ID: 61dc46c7-365b-480f-83e5-16cbc578a879 with Priority: HIGHEST for action security_group_members [ 758.302214] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61dc46c7-365b-480f-83e5-16cbc578a879 with Priority: HIGHEST for action security_group_members [ 758.302537] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-61dc46c7-365b-480f-83e5-16cbc578a879 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.302663] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.302730] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.302992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.303216] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.303319] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.303416] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.303554] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.303638] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.303733] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61dc46c7-365b-480f-83e5-16cbc578a879',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.511657] env[66834]: INFO networking_nsxv3.common.synchronization [req-0e2d4714-3841-4866-bea9-ef466cba2ceb req-5ffcdb9f-fd3a-4479-b800-150ea354ec6c tempest-AttachInterfacesUnderV243Test-828580212 tempest-AttachInterfacesUnderV243Test-828580212-project-member] Enqueued Resource ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 with Priority: HIGHEST for action security_group_members [ 758.513783] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 with Priority: HIGHEST for action security_group_members [ 758.513783] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.514016] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.514016] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.514302] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.514460] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.514581] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.514641] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.514794] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.514887] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.514986] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9117e7f6-fbaa-44a8-bc92-e3fb9acd2228',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.539415] env[66834]: INFO networking_nsxv3.common.synchronization [req-0e2d4714-3841-4866-bea9-ef466cba2ceb req-5ffcdb9f-fd3a-4479-b800-150ea354ec6c tempest-AttachInterfacesUnderV243Test-828580212 tempest-AttachInterfacesUnderV243Test-828580212-project-member] Enqueued Resource ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 with Priority: HIGHEST for action security_group_rules [ 758.539610] env[66834]: INFO networking_nsxv3.common.synchronization [req-0e2d4714-3841-4866-bea9-ef466cba2ceb req-5ffcdb9f-fd3a-4479-b800-150ea354ec6c tempest-AttachInterfacesUnderV243Test-828580212 tempest-AttachInterfacesUnderV243Test-828580212-project-member] Enqueued Resource ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 with Priority: HIGHEST for action security_group_members [ 758.539704] env[66834]: INFO networking_nsxv3.common.synchronization [req-0e2d4714-3841-4866-bea9-ef466cba2ceb req-5ffcdb9f-fd3a-4479-b800-150ea354ec6c tempest-AttachInterfacesUnderV243Test-828580212 tempest-AttachInterfacesUnderV243Test-828580212-project-member] Enqueued Resource ID: ca3e5c21-9407-4b0f-a878-dffb76bef40c with Priority: HIGHEST for action port [ 758.542071] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 with Priority: HIGHEST for action security_group_rules [ 758.542071] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 with Priority: HIGHEST for action security_group_members [ 758.542071] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca3e5c21-9407-4b0f-a878-dffb76bef40c with Priority: HIGHEST for action port [ 758.542071] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.542739] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.542739] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.542739] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.542739] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9117e7f6-fbaa-44a8-bc92-e3fb9acd2228',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.547030] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.547030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.547030] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca3e5c21-9407-4b0f-a878-dffb76bef40c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.547030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca3e5c21-9407-4b0f-a878-dffb76bef40c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.547030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca3e5c21-9407-4b0f-a878-dffb76bef40c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.547030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca3e5c21-9407-4b0f-a878-dffb76bef40c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.547030] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca3e5c21-9407-4b0f-a878-dffb76bef40c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.779134] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-614 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.779377] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-614" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.779445] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-614" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.779774] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-614" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.781104] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.784998] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.784998] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.784998] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.784998] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.784998] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.784998] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 758.784998] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 758.784998] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 758.784998] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.784998] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 758.784998] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 758.789465] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.789934] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.790203] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.790507] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.790686] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.790958] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 is going to be created. [ 758.807126] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.807467] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.811142] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.811142] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.811142] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.811142] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.811142] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.811142] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.811142] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.811142] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.811142] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61dc46c7-365b-480f-83e5-16cbc578a879 already deleted. [ 758.811142] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.924441] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 758.924508] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.141 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 758.924853] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 758.925052] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-614" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.925268] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-63260a1e-06fe-4306-a0e1-c0ac686ee56e taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.925450] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-63260a1e-06fe-4306-a0e1-c0ac686ee56e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.925585] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-63260a1e-06fe-4306-a0e1-c0ac686ee56e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.926050] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-63260a1e-06fe-4306-a0e1-c0ac686ee56e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.926162] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63260a1e-06fe-4306-a0e1-c0ac686ee56e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.935210] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.935210] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.935210] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.935210] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.935210] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.949882] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: SUCCESS [ 758.949882] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.949882] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.949882] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.949882] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.949882] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.949882] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.949882] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.949882] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.949882] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.949882] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.952311] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 in Status: UNINITIALIZED for 2s [ 759.016992] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9117e7f6-fbaa-44a8-bc92-e3fb9acd2228',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.049414] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.050414] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.051037] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca3e5c21-9407-4b0f-a878-dffb76bef40c with status ACTIVE [ 759.051311] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.051483] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.051591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.052016] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.052168] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.052676] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.054398] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.054398] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.054398] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.054570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.056041] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.056041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.056041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.056041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.056041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.056041] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca3e5c21-9407-4b0f-a878-dffb76bef40c is going to be updated. [ 759.085732] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.085732] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.085732] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.085974] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.086163] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.086310] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca3e5c21-9407-4b0f-a878-dffb76bef40c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.430778] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.430778] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.430778] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.430778] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.430778] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.430778] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 63260a1e-06fe-4306-a0e1-c0ac686ee56e not found, creating... [ 759.430778] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.430778] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.430778] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.431622] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.431622] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.431622] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.431622] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.431622] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.431923] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.431968] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.435686] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 63260a1e-06fe-4306-a0e1-c0ac686ee56e is going to be created. [ 759.453784] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.453948] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.454030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.454255] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.454419] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.454516] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.454598] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.454831] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.454955] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.455082] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.455219] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.455340] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.455431] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.456628] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.456809] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.456913] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.456979] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.457906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.458644] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.458644] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.458644] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.460088] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.460279] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.460401] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.460623] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.460834] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.461098] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-63260a1e-06fe-4306-a0e1-c0ac686ee56e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.520863] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9117e7f6-fbaa-44a8-bc92-e3fb9acd2228',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.963033] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7963c125-23b5-45fd-8158-f6470d12949e: rpc.has_security_group_logging(os_id): False [ 759.985058] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.985303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.985303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.985529] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.985590] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.985798] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.985897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.985956] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.986131] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.986213] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.986396] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.986489] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.986547] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.986688] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.986804] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.986931] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.987266] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.987363] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.987545] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.987624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.987709] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7963c125-23b5-45fd-8158-f6470d12949e is going to be updated. [ 760.027853] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.028080] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.028080] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.029068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.029068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.029068] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 is going to be updated. [ 760.065457] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.065457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.065457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.065457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.065457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.067496] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.067627] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.067686] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.067869] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.067998] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.081333] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 in Status: IN_PROGRESS for 2s [ 760.094291] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: IN_PROGRESS for 2s [ 760.100613] env[66834]: INFO networking_nsxv3.common.synchronization [req-105c3adb-f887-4ce1-992c-8e2f01c07c45 req-c0bfe815-7b2d-4c81-b230-5a49307dbb26 service nova] Enqueued Resource ID: 61dc46c7-365b-480f-83e5-16cbc578a879 with Priority: HIGHEST for action security_group_rules [ 760.100783] env[66834]: INFO networking_nsxv3.common.synchronization [req-105c3adb-f887-4ce1-992c-8e2f01c07c45 req-c0bfe815-7b2d-4c81-b230-5a49307dbb26 service nova] Enqueued Resource ID: 61dc46c7-365b-480f-83e5-16cbc578a879 with Priority: HIGHEST for action security_group_members [ 760.100932] env[66834]: INFO networking_nsxv3.common.synchronization [req-105c3adb-f887-4ce1-992c-8e2f01c07c45 req-c0bfe815-7b2d-4c81-b230-5a49307dbb26 service nova] Enqueued Resource ID: 63260a1e-06fe-4306-a0e1-c0ac686ee56e with Priority: HIGHEST for action port [ 760.101943] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: SUCCESS [ 760.102199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.102707] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61dc46c7-365b-480f-83e5-16cbc578a879 with Priority: HIGHEST for action security_group_rules [ 760.102833] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61dc46c7-365b-480f-83e5-16cbc578a879 with Priority: HIGHEST for action security_group_members [ 760.102928] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63260a1e-06fe-4306-a0e1-c0ac686ee56e with Priority: HIGHEST for action port [ 760.103107] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.103486] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.103686] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.103824] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.103892] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.104317] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.104317] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.104317] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.106088] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 in Status: SUCCESS [ 760.106340] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.106720] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61dc46c7-365b-480f-83e5-16cbc578a879 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.107290] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.107290] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.107290] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.107290] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61dc46c7-365b-480f-83e5-16cbc578a879',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.109256] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-61dc46c7-365b-480f-83e5-16cbc578a879 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.109256] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.109256] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.109256] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.109512] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.109602] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.110423] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.110423] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.110423] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.110423] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61dc46c7-365b-480f-83e5-16cbc578a879',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.110936] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-63260a1e-06fe-4306-a0e1-c0ac686ee56e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.111074] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63260a1e-06fe-4306-a0e1-c0ac686ee56e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.111162] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63260a1e-06fe-4306-a0e1-c0ac686ee56e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.111315] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63260a1e-06fe-4306-a0e1-c0ac686ee56e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.111875] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63260a1e-06fe-4306-a0e1-c0ac686ee56e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.113461] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.114188] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.114494] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.114616] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.114682] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.114850] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.115210] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.115210] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('782e10e2-c275-4c7b-bb67-ec47dc30cf73',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.618773] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-61dc46c7-365b-480f-83e5-16cbc578a879 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.619123] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.619225] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.621046] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('61dc46c7-365b-480f-83e5-16cbc578a879',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.633152] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63260a1e-06fe-4306-a0e1-c0ac686ee56e with status ACTIVE [ 760.633387] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.633547] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.633648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.633957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.633957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.634125] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.634224] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.634336] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.634459] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.634535] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.634716] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.635070] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.635070] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.635070] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.635070] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.635202] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63260a1e-06fe-4306-a0e1-c0ac686ee56e is going to be updated. [ 760.637695] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('782e10e2-c275-4c7b-bb67-ec47dc30cf73',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.673085] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.673085] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.673085] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.673422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.673422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.673489] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63260a1e-06fe-4306-a0e1-c0ac686ee56e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.969304] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 in Status: SUCCESS [ 760.969567] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.969714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.969998] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.970281] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.970442] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.970535] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.970881] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.970986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.971121] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.971874] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b0294dc-2245-46bf-a56e-f22fbf616a62',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.124647] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.124647] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('61dc46c7-365b-480f-83e5-16cbc578a879',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.139826] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('782e10e2-c275-4c7b-bb67-ec47dc30cf73',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.199598] env[66834]: INFO networking_nsxv3.common.synchronization [req-145e1dcf-b90e-4755-8d59-83684eb1f9d1 req-7d1fdd8c-7f66-4c48-9daf-58cda66c099b tempest-DeleteServersTestJSON-1250802255 tempest-DeleteServersTestJSON-1250802255-project-member] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 761.200284] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 761.200619] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.200760] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.200836] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.201565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.201771] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.201896] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.201964] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.202294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.203260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.203260] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.474337] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b0294dc-2245-46bf-a56e-f22fbf616a62',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.600660] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-606 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.600882] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.600978] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.601326] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.601586] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.601739] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.601845] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.602073] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.602273] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.602477] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.602612] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.602695] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.602781] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.602885] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.602986] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.603123] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.626560] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.627023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.627023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.627178] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.627233] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.627341] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21deb826-26b5-4246-96bf-34da6682babd is going to be updated. [ 761.629241] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.629428] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.629517] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.629742] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.629845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.629937] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61dc46c7-365b-480f-83e5-16cbc578a879 is going to be created. [ 761.631849] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.632090] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 761.632236] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.632403] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.632696] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-a7dd8bc6-cc87-4a0f-af25-15f06d119361 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.632855] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-a7dd8bc6-cc87-4a0f-af25-15f06d119361" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.632966] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-a7dd8bc6-cc87-4a0f-af25-15f06d119361" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.633290] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-a7dd8bc6-cc87-4a0f-af25-15f06d119361" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.633420] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7dd8bc6-cc87-4a0f-af25-15f06d119361',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.642573] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.642745] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.642792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.643006] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.643155] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.643190] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 is going to be updated. [ 761.662544] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.662700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.662773] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.664224] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.664224] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.666680] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.666680] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.666803] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.666969] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.667564] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.671818] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.671955] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.672068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.672341] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.672498] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.675249] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61dc46c7-365b-480f-83e5-16cbc578a879 in Status: UNINITIALIZED for 2s [ 761.679294] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: IN_PROGRESS for 2s [ 761.682358] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 in Status: IN_PROGRESS for 2s [ 761.705318] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.705468] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.705544] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.705770] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.705866] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.706070] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.706186] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.706301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.708016] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.708016] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.708016] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be updated. [ 761.745259] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.745449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.745490] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.745684] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.745820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.758574] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: IN_PROGRESS for 2s [ 761.980647] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b0294dc-2245-46bf-a56e-f22fbf616a62: rpc.has_security_group_logging(os_id): False [ 762.001445] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.001975] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.002293] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.002717] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.003641] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.003641] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.006994] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.006994] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.006994] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.006994] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.006994] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 is going to be created. [ 762.077167] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.077167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.077167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.077167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.077167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.097188] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 in Status: IN_PROGRESS for 2s [ 762.097188] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 in Status: SUCCESS [ 762.097188] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.101215] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.101215] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.101215] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.101215] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.101215] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.101215] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.101215] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.101215] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9117e7f6-fbaa-44a8-bc92-e3fb9acd2228',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.116073] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: SUCCESS [ 762.116073] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.141187] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.141187] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.141187] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.141187] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.141187] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.141187] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port a7dd8bc6-cc87-4a0f-af25-15f06d119361 not found, creating... [ 762.141187] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.141187] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.141187] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.141187] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.141187] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.141656] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.141656] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.141994] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.142384] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.142652] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.142941] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: a7dd8bc6-cc87-4a0f-af25-15f06d119361 is going to be created. [ 762.174983] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.174983] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.174983] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.174983] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.174983] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.174983] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-a7dd8bc6-cc87-4a0f-af25-15f06d119361" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.603275] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9117e7f6-fbaa-44a8-bc92-e3fb9acd2228',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.947312] env[66834]: INFO networking_nsxv3.common.synchronization [req-145e1dcf-b90e-4755-8d59-83684eb1f9d1 req-1b94a126-5507-4659-82f3-20d40cff50ea service nova] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_rules [ 762.947517] env[66834]: INFO networking_nsxv3.common.synchronization [req-145e1dcf-b90e-4755-8d59-83684eb1f9d1 req-1b94a126-5507-4659-82f3-20d40cff50ea service nova] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 762.947695] env[66834]: INFO networking_nsxv3.common.synchronization [req-145e1dcf-b90e-4755-8d59-83684eb1f9d1 req-1b94a126-5507-4659-82f3-20d40cff50ea service nova] Enqueued Resource ID: a7dd8bc6-cc87-4a0f-af25-15f06d119361 with Priority: HIGHEST for action port [ 762.948723] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_rules [ 762.948922] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 762.949068] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7dd8bc6-cc87-4a0f-af25-15f06d119361 with Priority: HIGHEST for action port [ 762.949392] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.949534] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.949605] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.949810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.949907] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.953887] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.954015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.954135] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7dd8bc6-cc87-4a0f-af25-15f06d119361 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.954241] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7dd8bc6-cc87-4a0f-af25-15f06d119361" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.954321] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7dd8bc6-cc87-4a0f-af25-15f06d119361" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.954540] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7dd8bc6-cc87-4a0f-af25-15f06d119361" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.954768] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7dd8bc6-cc87-4a0f-af25-15f06d119361',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.109180] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9117e7f6-fbaa-44a8-bc92-e3fb9acd2228',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.179320] env[66834]: INFO networking_nsxv3.common.synchronization [req-b3c45e2e-d5fd-41f1-8502-70c50172cb46 req-165345b0-d158-4468-ba85-2961a4ea1f10 tempest-AttachInterfacesUnderV243Test-828580212 tempest-AttachInterfacesUnderV243Test-828580212-project-member] Enqueued Resource ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 with Priority: HIGHEST for action security_group_members [ 763.180135] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 with Priority: HIGHEST for action security_group_members [ 763.180695] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.180783] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.199546] env[66834]: INFO networking_nsxv3.common.synchronization [req-b3c45e2e-d5fd-41f1-8502-70c50172cb46 req-165345b0-d158-4468-ba85-2961a4ea1f10 tempest-AttachInterfacesUnderV243Test-828580212 tempest-AttachInterfacesUnderV243Test-828580212-project-member] Enqueued Resource ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 with Priority: HIGHEST for action security_group_rules [ 763.199546] env[66834]: INFO networking_nsxv3.common.synchronization [req-b3c45e2e-d5fd-41f1-8502-70c50172cb46 req-165345b0-d158-4468-ba85-2961a4ea1f10 tempest-AttachInterfacesUnderV243Test-828580212 tempest-AttachInterfacesUnderV243Test-828580212-project-member] Enqueued Resource ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 with Priority: HIGHEST for action security_group_members [ 763.199663] env[66834]: INFO networking_nsxv3.common.synchronization [req-b3c45e2e-d5fd-41f1-8502-70c50172cb46 req-165345b0-d158-4468-ba85-2961a4ea1f10 tempest-AttachInterfacesUnderV243Test-828580212 tempest-AttachInterfacesUnderV243Test-828580212-project-member] Enqueued Resource ID: ca3e5c21-9407-4b0f-a878-dffb76bef40c with Priority: HIGHEST for action port [ 763.200586] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 with Priority: HIGHEST for action security_group_rules [ 763.200870] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 with Priority: HIGHEST for action security_group_members [ 763.200963] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca3e5c21-9407-4b0f-a878-dffb76bef40c with Priority: HIGHEST for action port [ 763.201447] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.201742] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.202655] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.202655] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.202655] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca3e5c21-9407-4b0f-a878-dffb76bef40c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.202655] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca3e5c21-9407-4b0f-a878-dffb76bef40c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.202655] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca3e5c21-9407-4b0f-a878-dffb76bef40c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.202959] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca3e5c21-9407-4b0f-a878-dffb76bef40c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.202959] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca3e5c21-9407-4b0f-a878-dffb76bef40c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.455631] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.455631] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.457453] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7dd8bc6-cc87-4a0f-af25-15f06d119361 with status ACTIVE [ 763.457552] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.457758] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.457758] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.458213] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.458213] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.458456] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.458456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.458558] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.458804] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.458804] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.459205] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.459205] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.459205] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.459332] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.459776] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.459776] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7dd8bc6-cc87-4a0f-af25-15f06d119361 is going to be updated. [ 763.486384] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.486601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.486601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.487437] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.487437] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.487437] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7dd8bc6-cc87-4a0f-af25-15f06d119361" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.612192] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.612546] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.612754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.613123] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.614884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.614884] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 is going to be updated. [ 763.656027] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.656216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.656284] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.656653] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.656653] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.668440] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 in Status: IN_PROGRESS for 2s [ 763.694863] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61dc46c7-365b-480f-83e5-16cbc578a879 in Status: SUCCESS [ 763.695112] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.695310] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.695552] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.695794] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.695923] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.695991] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.696184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.696301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.696412] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.696452] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('61dc46c7-365b-480f-83e5-16cbc578a879',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.698682] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: SUCCESS [ 763.698941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.699517] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.701422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.701422] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.701422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.701422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.701422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.701422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.701422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.701422] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.702413] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 in Status: SUCCESS [ 763.702555] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.702716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.703268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.703268] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.703447] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.703447] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.703885] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.703885] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.703885] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.703885] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('782e10e2-c275-4c7b-bb67-ec47dc30cf73',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.706725] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca3e5c21-9407-4b0f-a878-dffb76bef40c with status ACTIVE [ 763.706725] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.706725] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.706725] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.708045] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.708045] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.708045] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.708045] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.708045] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.708045] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.708045] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.708045] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.708045] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.708045] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.708447] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.708447] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.708447] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca3e5c21-9407-4b0f-a878-dffb76bef40c is going to be updated. [ 763.743823] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.743823] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.743823] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.743823] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.743823] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.743823] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca3e5c21-9407-4b0f-a878-dffb76bef40c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.774672] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: SUCCESS [ 763.774933] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a deletion is rescheduled due to dependency. [ 763.775100] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.775338] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.775621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.776061] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.776243] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.776338] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.776575] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.776745] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.776873] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.109841] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 in Status: SUCCESS [ 764.110300] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.203822] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('61dc46c7-365b-480f-83e5-16cbc578a879',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.207629] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.207629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.207629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.207629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.207629] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.207629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.207629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.207629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.207629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.207629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.207629] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.207629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.207629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.208435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.208435] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.208435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.208435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.208435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.208435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.208435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.208435] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.209465] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('782e10e2-c275-4c7b-bb67-ec47dc30cf73',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.281658] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.705810] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 61dc46c7-365b-480f-83e5-16cbc578a879: rpc.has_security_group_logging(os_id): False [ 764.713087] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21deb826-26b5-4246-96bf-34da6682babd: rpc.has_security_group_logging(os_id): False [ 764.714950] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 782e10e2-c275-4c7b-bb67-ec47dc30cf73: rpc.has_security_group_logging(os_id): False [ 764.736431] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.736431] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.736431] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.736726] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.736726] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.737044] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.737144] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.737144] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.737431] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.737431] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.737607] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61dc46c7-365b-480f-83e5-16cbc578a879 is going to be created. [ 764.740036] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.740275] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.740385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.740758] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.740758] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.740904] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.740988] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.741070] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.741265] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.741380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.741660] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.741790] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.741873] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.742123] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.742261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.742563] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.742727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.742801] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.742970] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.743089] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.743701] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21deb826-26b5-4246-96bf-34da6682babd is going to be updated. [ 764.744965] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.745136] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.745226] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.745386] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.745554] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.745797] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.745872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.745872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.746042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.746124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.746257] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 is going to be created. [ 764.785989] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.806968] env[66834]: INFO networking_nsxv3.common.synchronization [req-85d6cd03-2c55-476b-a7d9-75a378c0ef83 req-1511cd9a-82ba-4f98-b196-edbe214e54a1 tempest-ServerRescueTestJSONUnderV235-1924768781 tempest-ServerRescueTestJSONUnderV235-1924768781-project-member] Enqueued Resource ID: df799599-b9e4-4fae-8e7f-51d9f32552eb with Priority: HIGHEST for action security_group_members [ 764.807708] env[66834]: INFO networking_nsxv3.common.synchronization [req-85d6cd03-2c55-476b-a7d9-75a378c0ef83 req-1511cd9a-82ba-4f98-b196-edbe214e54a1 tempest-ServerRescueTestJSONUnderV235-1924768781 tempest-ServerRescueTestJSONUnderV235-1924768781-project-member] Enqueued Resource ID: a41415ed-2788-44fc-9776-a1eea5a113ed with Priority: HIGHEST for action security_group_members [ 764.808332] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df799599-b9e4-4fae-8e7f-51d9f32552eb with Priority: HIGHEST for action security_group_members [ 764.808436] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a41415ed-2788-44fc-9776-a1eea5a113ed with Priority: HIGHEST for action security_group_members [ 764.808726] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-df799599-b9e4-4fae-8e7f-51d9f32552eb taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.808891] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df799599-b9e4-4fae-8e7f-51d9f32552eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.808967] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df799599-b9e4-4fae-8e7f-51d9f32552eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.809237] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df799599-b9e4-4fae-8e7f-51d9f32552eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.809398] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.809504] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.809576] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.810056] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.810056] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.810056] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df799599-b9e4-4fae-8e7f-51d9f32552eb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.811700] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a41415ed-2788-44fc-9776-a1eea5a113ed taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.811700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.811700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.811700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.811700] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.811700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.811700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.812133] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.812133] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.812133] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a41415ed-2788-44fc-9776-a1eea5a113ed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.815920] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.816077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.816125] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.816677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.816677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.830564] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 in Status: IN_PROGRESS for 2s [ 764.836878] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.837069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.837069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.837335] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.837628] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.841425] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.841554] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.841621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.841814] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.841956] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.853722] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61dc46c7-365b-480f-83e5-16cbc578a879 in Status: IN_PROGRESS for 2s [ 764.859979] env[66834]: INFO networking_nsxv3.common.synchronization [req-85d6cd03-2c55-476b-a7d9-75a378c0ef83 req-1511cd9a-82ba-4f98-b196-edbe214e54a1 tempest-ServerRescueTestJSONUnderV235-1924768781 tempest-ServerRescueTestJSONUnderV235-1924768781-project-member] Enqueued Resource ID: a41415ed-2788-44fc-9776-a1eea5a113ed with Priority: HIGHEST for action security_group_rules [ 764.860189] env[66834]: INFO networking_nsxv3.common.synchronization [req-85d6cd03-2c55-476b-a7d9-75a378c0ef83 req-1511cd9a-82ba-4f98-b196-edbe214e54a1 tempest-ServerRescueTestJSONUnderV235-1924768781 tempest-ServerRescueTestJSONUnderV235-1924768781-project-member] Enqueued Resource ID: a41415ed-2788-44fc-9776-a1eea5a113ed with Priority: HIGHEST for action security_group_members [ 764.860322] env[66834]: INFO networking_nsxv3.common.synchronization [req-85d6cd03-2c55-476b-a7d9-75a378c0ef83 req-1511cd9a-82ba-4f98-b196-edbe214e54a1 tempest-ServerRescueTestJSONUnderV235-1924768781 tempest-ServerRescueTestJSONUnderV235-1924768781-project-member] Enqueued Resource ID: df799599-b9e4-4fae-8e7f-51d9f32552eb with Priority: HIGHEST for action security_group_rules [ 764.860442] env[66834]: INFO networking_nsxv3.common.synchronization [req-85d6cd03-2c55-476b-a7d9-75a378c0ef83 req-1511cd9a-82ba-4f98-b196-edbe214e54a1 tempest-ServerRescueTestJSONUnderV235-1924768781 tempest-ServerRescueTestJSONUnderV235-1924768781-project-member] Enqueued Resource ID: df799599-b9e4-4fae-8e7f-51d9f32552eb with Priority: HIGHEST for action security_group_members [ 764.860587] env[66834]: INFO networking_nsxv3.common.synchronization [req-85d6cd03-2c55-476b-a7d9-75a378c0ef83 req-1511cd9a-82ba-4f98-b196-edbe214e54a1 tempest-ServerRescueTestJSONUnderV235-1924768781 tempest-ServerRescueTestJSONUnderV235-1924768781-project-member] Enqueued Resource ID: 06caac5c-6b6d-4b66-9e4c-5158725a8d18 with Priority: HIGHEST for action port [ 764.861056] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a41415ed-2788-44fc-9776-a1eea5a113ed with Priority: HIGHEST for action security_group_rules [ 764.861580] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df799599-b9e4-4fae-8e7f-51d9f32552eb with Priority: HIGHEST for action security_group_rules [ 764.861702] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06caac5c-6b6d-4b66-9e4c-5158725a8d18 with Priority: HIGHEST for action port [ 764.861798] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a41415ed-2788-44fc-9776-a1eea5a113ed with Priority: HIGHEST for action security_group_members [ 764.861887] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df799599-b9e4-4fae-8e7f-51d9f32552eb with Priority: HIGHEST for action security_group_members [ 764.862206] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a41415ed-2788-44fc-9776-a1eea5a113ed taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.862333] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.862399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.862594] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.862680] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a41415ed-2788-44fc-9776-a1eea5a113ed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.863564] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df799599-b9e4-4fae-8e7f-51d9f32552eb taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.863692] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df799599-b9e4-4fae-8e7f-51d9f32552eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.863774] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df799599-b9e4-4fae-8e7f-51d9f32552eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.864012] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df799599-b9e4-4fae-8e7f-51d9f32552eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.864114] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df799599-b9e4-4fae-8e7f-51d9f32552eb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.864857] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-06caac5c-6b6d-4b66-9e4c-5158725a8d18 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.864967] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06caac5c-6b6d-4b66-9e4c-5158725a8d18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.865046] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06caac5c-6b6d-4b66-9e4c-5158725a8d18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.865273] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06caac5c-6b6d-4b66-9e4c-5158725a8d18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.865273] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06caac5c-6b6d-4b66-9e4c-5158725a8d18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.865928] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a41415ed-2788-44fc-9776-a1eea5a113ed taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.866038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.866212] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-df799599-b9e4-4fae-8e7f-51d9f32552eb taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.866313] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df799599-b9e4-4fae-8e7f-51d9f32552eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.867096] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: IN_PROGRESS for 2s [ 765.288907] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.289277] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.289277] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.289561] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.289684] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.289878] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be updated. [ 765.314154] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df799599-b9e4-4fae-8e7f-51d9f32552eb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.315289] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a41415ed-2788-44fc-9776-a1eea5a113ed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.323035] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.323183] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.323183] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.323585] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.323585] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.336613] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: IN_PROGRESS for 2s [ 765.368556] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a41415ed-2788-44fc-9776-a1eea5a113ed taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.368556] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.368795] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 06caac5c-6b6d-4b66-9e4c-5158725a8d18 with status ACTIVE [ 765.369170] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.369370] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.369594] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.369707] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.369707] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.369906] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.370029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.370079] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.370287] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.370319] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.370504] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.370595] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.370651] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.370794] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.370867] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.370953] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 06caac5c-6b6d-4b66-9e4c-5158725a8d18 is going to be updated. [ 765.372319] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-df799599-b9e4-4fae-8e7f-51d9f32552eb taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.372432] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df799599-b9e4-4fae-8e7f-51d9f32552eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.397683] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.397849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.397889] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.398098] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.398249] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.398482] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06caac5c-6b6d-4b66-9e4c-5158725a8d18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.592261] env[66834]: INFO networking_nsxv3.common.synchronization [req-4f11c902-8d60-422c-8bbd-378200bf8a37 req-8769fdac-f5dc-49b2-b514-58725b3cf013 tempest-ServerRescueTestJSONUnderV235-1924768781 tempest-ServerRescueTestJSONUnderV235-1924768781-project-member] Enqueued Resource ID: df799599-b9e4-4fae-8e7f-51d9f32552eb with Priority: HIGHEST for action security_group_members [ 765.592318] env[66834]: INFO networking_nsxv3.common.synchronization [req-4f11c902-8d60-422c-8bbd-378200bf8a37 req-8769fdac-f5dc-49b2-b514-58725b3cf013 tempest-ServerRescueTestJSONUnderV235-1924768781 tempest-ServerRescueTestJSONUnderV235-1924768781-project-member] Enqueued Resource ID: a41415ed-2788-44fc-9776-a1eea5a113ed with Priority: HIGHEST for action security_group_members [ 765.593060] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df799599-b9e4-4fae-8e7f-51d9f32552eb with Priority: HIGHEST for action security_group_members [ 765.593323] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a41415ed-2788-44fc-9776-a1eea5a113ed with Priority: HIGHEST for action security_group_members [ 765.593712] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-df799599-b9e4-4fae-8e7f-51d9f32552eb taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.594339] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df799599-b9e4-4fae-8e7f-51d9f32552eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.594932] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a41415ed-2788-44fc-9776-a1eea5a113ed taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.595025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.651971] env[66834]: INFO networking_nsxv3.common.synchronization [req-4f11c902-8d60-422c-8bbd-378200bf8a37 req-8769fdac-f5dc-49b2-b514-58725b3cf013 tempest-ServerRescueTestJSONUnderV235-1924768781 tempest-ServerRescueTestJSONUnderV235-1924768781-project-member] Enqueued Resource ID: a41415ed-2788-44fc-9776-a1eea5a113ed with Priority: HIGHEST for action security_group_rules [ 765.652367] env[66834]: INFO networking_nsxv3.common.synchronization [req-4f11c902-8d60-422c-8bbd-378200bf8a37 req-8769fdac-f5dc-49b2-b514-58725b3cf013 tempest-ServerRescueTestJSONUnderV235-1924768781 tempest-ServerRescueTestJSONUnderV235-1924768781-project-member] Enqueued Resource ID: a41415ed-2788-44fc-9776-a1eea5a113ed with Priority: HIGHEST for action security_group_members [ 765.652645] env[66834]: INFO networking_nsxv3.common.synchronization [req-4f11c902-8d60-422c-8bbd-378200bf8a37 req-8769fdac-f5dc-49b2-b514-58725b3cf013 tempest-ServerRescueTestJSONUnderV235-1924768781 tempest-ServerRescueTestJSONUnderV235-1924768781-project-member] Enqueued Resource ID: 06caac5c-6b6d-4b66-9e4c-5158725a8d18 with Priority: HIGHEST for action port [ 765.653522] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a41415ed-2788-44fc-9776-a1eea5a113ed with Priority: HIGHEST for action security_group_rules [ 765.653703] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a41415ed-2788-44fc-9776-a1eea5a113ed with Priority: HIGHEST for action security_group_members [ 765.653954] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06caac5c-6b6d-4b66-9e4c-5158725a8d18 with Priority: HIGHEST for action port [ 765.654420] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a41415ed-2788-44fc-9776-a1eea5a113ed taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.654498] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.654764] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a41415ed-2788-44fc-9776-a1eea5a113ed taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.655177] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.656387] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-06caac5c-6b6d-4b66-9e4c-5158725a8d18 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.656387] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06caac5c-6b6d-4b66-9e4c-5158725a8d18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.656387] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06caac5c-6b6d-4b66-9e4c-5158725a8d18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.656387] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06caac5c-6b6d-4b66-9e4c-5158725a8d18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.656387] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06caac5c-6b6d-4b66-9e4c-5158725a8d18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.685851] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 in Status: SUCCESS [ 765.685851] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.685851] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.685851] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.685851] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.685851] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.685851] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.685851] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.685851] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.685851] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.685851] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9117e7f6-fbaa-44a8-bc92-e3fb9acd2228',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.687162] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.687487] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.687758] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.687986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.688145] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.688370] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.688564] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.688740] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9117e7f6-fbaa-44a8-bc92-e3fb9acd2228',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.817456] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df799599-b9e4-4fae-8e7f-51d9f32552eb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.819094] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a41415ed-2788-44fc-9776-a1eea5a113ed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.860238] env[66834]: INFO networking_nsxv3.common.synchronization [req-4a563090-7613-4516-b092-f9981cfa0cf1 req-a71f9f43-c863-49b4-8904-89144be92387 tempest-ListServerFiltersTestJSON-1401422689 tempest-ListServerFiltersTestJSON-1401422689-project-member] Enqueued Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGHEST for action security_group_members [ 765.862189] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGHEST for action security_group_members [ 765.862189] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.862189] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.862361] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.862556] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.862906] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.862906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.863044] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.863486] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.864466] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.864466] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.161457] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 06caac5c-6b6d-4b66-9e4c-5158725a8d18 with status ACTIVE [ 766.161699] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.161845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.161927] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.162162] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.163277] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.163277] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.163277] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.163277] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.163277] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.163277] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.163277] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.163277] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.163277] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.163790] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.163790] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.163790] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 06caac5c-6b6d-4b66-9e4c-5158725a8d18 is going to be updated. [ 766.190281] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.190454] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.190519] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.190683] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.190814] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.190978] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06caac5c-6b6d-4b66-9e4c-5158725a8d18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.191237] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9117e7f6-fbaa-44a8-bc92-e3fb9acd2228',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.192709] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9117e7f6-fbaa-44a8-bc92-e3fb9acd2228',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.316600] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-437 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.317068] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-437" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.317327] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-437" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.317695] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-437" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.318109] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.318352] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.318646] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.318936] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.319091] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.319382] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 766.319537] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 766.319828] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 766.319828] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 766.319975] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 766.320183] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 766.320414] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 766.322912] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.323083] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.323211] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.323510] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.323734] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.323734] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a41415ed-2788-44fc-9776-a1eea5a113ed is going to be updated. [ 766.325315] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.325533] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.325605] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.325899] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.326194] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.326194] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df799599-b9e4-4fae-8e7f-51d9f32552eb is going to be created. [ 766.359889] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 766.360143] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 766.360358] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 766.360497] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-437" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.361054] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-f46b958b-c372-4d90-8422-f5c1fad4befb taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.361054] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-f46b958b-c372-4d90-8422-f5c1fad4befb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.361327] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-f46b958b-c372-4d90-8422-f5c1fad4befb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.361435] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-f46b958b-c372-4d90-8422-f5c1fad4befb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.361574] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f46b958b-c372-4d90-8422-f5c1fad4befb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.367069] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.367260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.367312] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.367551] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.367689] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.367887] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.368079] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.368079] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.368255] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.368327] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.368423] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ce997a4-e173-41da-a149-86945dba84fe already deleted. [ 766.368504] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.371067] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.371340] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.371340] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.371473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.371631] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.375773] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.375894] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.375894] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.376166] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.376315] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.385518] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a41415ed-2788-44fc-9776-a1eea5a113ed in Status: IN_PROGRESS for 2s [ 766.386275] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df799599-b9e4-4fae-8e7f-51d9f32552eb in Status: UNINITIALIZED for 2s [ 766.695624] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228: rpc.has_security_group_logging(os_id): False [ 766.695785] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9117e7f6-fbaa-44a8-bc92-e3fb9acd2228',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.729893] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.729893] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.729893] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.729893] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.729893] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.729893] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.729893] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.730524] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.730981] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.731398] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.731710] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 is going to be updated. [ 766.837617] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.837617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.837617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.837617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.837617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.848945] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 in Status: SUCCESS [ 766.849302] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.850418] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 in Status: IN_PROGRESS for 2s [ 766.864616] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.864827] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.864934] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.865362] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.865409] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.865547] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port f46b958b-c372-4d90-8422-f5c1fad4befb not found, creating... [ 766.865859] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.866048] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.866301] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.866415] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.866556] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.867245] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.867245] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.867479] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.867654] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.867823] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.868015] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: f46b958b-c372-4d90-8422-f5c1fad4befb is going to be created. [ 766.871157] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61dc46c7-365b-480f-83e5-16cbc578a879 in Status: SUCCESS [ 766.871436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.889901] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: SUCCESS [ 766.890154] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.898012] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.898012] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.898229] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.898616] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.898972] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.902991] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-f46b958b-c372-4d90-8422-f5c1fad4befb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.199114] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.199367] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.199471] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.199900] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.200030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.200162] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 is going to be updated. [ 767.233869] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.234114] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.234236] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.234530] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.234709] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.247552] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 in Status: IN_PROGRESS for 2s [ 767.349937] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: SUCCESS [ 767.350348] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.350430] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.350692] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.350905] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.351043] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.351111] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.351299] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.351386] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.351476] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.351574] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.452941] env[66834]: INFO networking_nsxv3.common.synchronization [req-bd9032b7-520b-4a6e-83f3-eaf886a09397 req-fecf52ed-871a-4300-a8a6-4c1f6e07012c tempest-AttachInterfacesUnderV243Test-828580212 tempest-AttachInterfacesUnderV243Test-828580212-project-member] Enqueued Resource ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 with Priority: HIGHEST for action security_group_members [ 767.453577] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 with Priority: HIGHEST for action security_group_members [ 767.453892] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.453995] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.635535] env[66834]: INFO networking_nsxv3.common.synchronization [req-4a563090-7613-4516-b092-f9981cfa0cf1 req-75ff428a-1c67-4b7b-88fd-826f5a2f05fe service nova] Enqueued Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGHEST for action security_group_rules [ 767.635719] env[66834]: INFO networking_nsxv3.common.synchronization [req-4a563090-7613-4516-b092-f9981cfa0cf1 req-75ff428a-1c67-4b7b-88fd-826f5a2f05fe service nova] Enqueued Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGHEST for action security_group_members [ 767.635853] env[66834]: INFO networking_nsxv3.common.synchronization [req-4a563090-7613-4516-b092-f9981cfa0cf1 req-75ff428a-1c67-4b7b-88fd-826f5a2f05fe service nova] Enqueued Resource ID: f46b958b-c372-4d90-8422-f5c1fad4befb with Priority: HIGHEST for action port [ 767.636352] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGHEST for action security_group_rules [ 767.636483] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGHEST for action security_group_members [ 767.636579] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f46b958b-c372-4d90-8422-f5c1fad4befb with Priority: HIGHEST for action port [ 767.637133] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.637243] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.637347] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.637564] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.637667] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.640588] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.640714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.641170] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.641416] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.641553] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.641755] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.641823] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.642013] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.642108] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.642805] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.643495] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-f46b958b-c372-4d90-8422-f5c1fad4befb taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.643650] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f46b958b-c372-4d90-8422-f5c1fad4befb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.643686] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f46b958b-c372-4d90-8422-f5c1fad4befb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.643846] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f46b958b-c372-4d90-8422-f5c1fad4befb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.643924] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f46b958b-c372-4d90-8422-f5c1fad4befb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.855195] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.855431] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.855800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.855800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.855955] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.856077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.856136] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.856295] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.856415] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.856465] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.856610] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.856693] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.856784] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.856950] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.857109] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.857196] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.857272] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.857596] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.857678] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.857810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.857858] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.933726] env[66834]: INFO networking_nsxv3.common.synchronization [req-81efab3d-5b67-4319-bf1b-c00b3ef53d30 req-b2409cfb-a2c4-4a8a-8c3b-c3ff3b4d9f4d tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 with Priority: HIGHEST for action security_group_members [ 767.933726] env[66834]: INFO networking_nsxv3.common.synchronization [req-81efab3d-5b67-4319-bf1b-c00b3ef53d30 req-b2409cfb-a2c4-4a8a-8c3b-c3ff3b4d9f4d tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 767.933904] env[66834]: INFO networking_nsxv3.common.synchronization [req-81efab3d-5b67-4319-bf1b-c00b3ef53d30 req-b2409cfb-a2c4-4a8a-8c3b-c3ff3b4d9f4d tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 876f2bba-a1aa-45c2-b7af-e384fa951e08 with Priority: HIGHEST for action security_group_members [ 767.935148] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 with Priority: HIGHEST for action security_group_members [ 767.935148] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 767.935148] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 876f2bba-a1aa-45c2-b7af-e384fa951e08 with Priority: HIGHEST for action security_group_members [ 767.935148] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-782e10e2-c275-4c7b-bb67-ec47dc30cf73 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.935148] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.935819] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.937963] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.937963] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.937963] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.937963] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.937963] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.937963] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.937963] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('782e10e2-c275-4c7b-bb67-ec47dc30cf73',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.938527] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.938676] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.938740] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.938916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.939865] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.939865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.939865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.939865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.939865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.939865] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.941360] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-876f2bba-a1aa-45c2-b7af-e384fa951e08 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.941360] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-876f2bba-a1aa-45c2-b7af-e384fa951e08" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.941360] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-876f2bba-a1aa-45c2-b7af-e384fa951e08" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.941360] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-876f2bba-a1aa-45c2-b7af-e384fa951e08" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.941360] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.941360] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.941360] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.942466] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.942633] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.942772] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('876f2bba-a1aa-45c2-b7af-e384fa951e08',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.019518] env[66834]: INFO networking_nsxv3.common.synchronization [req-81efab3d-5b67-4319-bf1b-c00b3ef53d30 req-b2409cfb-a2c4-4a8a-8c3b-c3ff3b4d9f4d tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_rules [ 768.020183] env[66834]: INFO networking_nsxv3.common.synchronization [req-81efab3d-5b67-4319-bf1b-c00b3ef53d30 req-b2409cfb-a2c4-4a8a-8c3b-c3ff3b4d9f4d tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 768.020348] env[66834]: INFO networking_nsxv3.common.synchronization [req-81efab3d-5b67-4319-bf1b-c00b3ef53d30 req-b2409cfb-a2c4-4a8a-8c3b-c3ff3b4d9f4d tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 with Priority: HIGHEST for action security_group_rules [ 768.020490] env[66834]: INFO networking_nsxv3.common.synchronization [req-81efab3d-5b67-4319-bf1b-c00b3ef53d30 req-b2409cfb-a2c4-4a8a-8c3b-c3ff3b4d9f4d tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 with Priority: HIGHEST for action security_group_members [ 768.020618] env[66834]: INFO networking_nsxv3.common.synchronization [req-81efab3d-5b67-4319-bf1b-c00b3ef53d30 req-b2409cfb-a2c4-4a8a-8c3b-c3ff3b4d9f4d tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 876f2bba-a1aa-45c2-b7af-e384fa951e08 with Priority: HIGHEST for action security_group_rules [ 768.020739] env[66834]: INFO networking_nsxv3.common.synchronization [req-81efab3d-5b67-4319-bf1b-c00b3ef53d30 req-b2409cfb-a2c4-4a8a-8c3b-c3ff3b4d9f4d tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 876f2bba-a1aa-45c2-b7af-e384fa951e08 with Priority: HIGHEST for action security_group_members [ 768.020861] env[66834]: INFO networking_nsxv3.common.synchronization [req-81efab3d-5b67-4319-bf1b-c00b3ef53d30 req-b2409cfb-a2c4-4a8a-8c3b-c3ff3b4d9f4d tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: d7d14587-9c33-4f63-bdfa-4032543cd8b0 with Priority: HIGHEST for action port [ 768.021825] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_rules [ 768.022156] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 with Priority: HIGHEST for action security_group_rules [ 768.022156] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 876f2bba-a1aa-45c2-b7af-e384fa951e08 with Priority: HIGHEST for action security_group_members [ 768.022156] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d14587-9c33-4f63-bdfa-4032543cd8b0 with Priority: HIGHEST for action port [ 768.022647] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 876f2bba-a1aa-45c2-b7af-e384fa951e08 with Priority: HIGHEST for action security_group_rules [ 768.022647] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 768.022647] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 with Priority: HIGHEST for action security_group_members [ 768.022755] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.022829] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.022894] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.023906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.023992] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.025133] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-782e10e2-c275-4c7b-bb67-ec47dc30cf73 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.025328] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.025328] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.025519] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.025601] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('782e10e2-c275-4c7b-bb67-ec47dc30cf73',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.026514] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-876f2bba-a1aa-45c2-b7af-e384fa951e08 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.026636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-876f2bba-a1aa-45c2-b7af-e384fa951e08" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.026959] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7d14587-9c33-4f63-bdfa-4032543cd8b0 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.026959] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7d14587-9c33-4f63-bdfa-4032543cd8b0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.026959] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7d14587-9c33-4f63-bdfa-4032543cd8b0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.028081] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7d14587-9c33-4f63-bdfa-4032543cd8b0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.028210] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7d14587-9c33-4f63-bdfa-4032543cd8b0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.029732] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-876f2bba-a1aa-45c2-b7af-e384fa951e08 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.029900] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-876f2bba-a1aa-45c2-b7af-e384fa951e08" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.029996] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-876f2bba-a1aa-45c2-b7af-e384fa951e08" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.030290] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-876f2bba-a1aa-45c2-b7af-e384fa951e08" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.030381] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('876f2bba-a1aa-45c2-b7af-e384fa951e08',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.030797] env[66834]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 768.031567] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.031682] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.031878] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-782e10e2-c275-4c7b-bb67-ec47dc30cf73 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.032509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.140998] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.141249] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.144769] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.145756] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f46b958b-c372-4d90-8422-f5c1fad4befb with status ACTIVE [ 768.145890] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.145995] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.145995] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.146256] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.146298] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.146667] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.146667] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.146667] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.146890] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.146890] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.147412] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.147412] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.147412] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.147412] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.147690] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.147690] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f46b958b-c372-4d90-8422-f5c1fad4befb is going to be updated. [ 768.162515] env[66834]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] NSXv3 Agent Agent loop - iteration:0 completed [ 768.162646] env[66834]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] NSXv3 Agent Agent loop - iteration:1 started [ 768.172362] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.172362] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.172599] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.172660] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.172801] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.172968] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f46b958b-c372-4d90-8422-f5c1fad4befb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.361039] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a15c14c6-0aee-4e9d-b481-2661c510f44a: rpc.has_security_group_logging(os_id): False [ 768.385214] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.385413] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.385485] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.385693] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.385778] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.386025] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.386124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.386186] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.386354] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.386431] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.386615] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.386709] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.386777] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.387092] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.387197] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.387478] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.387594] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.387660] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.387828] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.387911] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.388332] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be updated. [ 768.402514] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a41415ed-2788-44fc-9776-a1eea5a113ed in Status: SUCCESS [ 768.402731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.402906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.403150] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.403333] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.403448] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.403515] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.403669] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.403740] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.403840] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a41415ed-2788-44fc-9776-a1eea5a113ed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.405397] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df799599-b9e4-4fae-8e7f-51d9f32552eb in Status: SUCCESS [ 768.405576] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df799599-b9e4-4fae-8e7f-51d9f32552eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.405721] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df799599-b9e4-4fae-8e7f-51d9f32552eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.405889] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df799599-b9e4-4fae-8e7f-51d9f32552eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.406070] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.406178] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.406243] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.406385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.406461] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.406549] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df799599-b9e4-4fae-8e7f-51d9f32552eb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.445646] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.446611] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('782e10e2-c275-4c7b-bb67-ec47dc30cf73',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.447670] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('876f2bba-a1aa-45c2-b7af-e384fa951e08',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.466038] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.466248] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.466248] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.466396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.466546] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.484923] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: IN_PROGRESS for 2s [ 768.533914] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-876f2bba-a1aa-45c2-b7af-e384fa951e08 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.534134] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-876f2bba-a1aa-45c2-b7af-e384fa951e08" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.534265] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7d14587-9c33-4f63-bdfa-4032543cd8b0 with status ACTIVE [ 768.534442] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.534591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.534642] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.534824] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.534965] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.535119] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.535300] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.535300] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.535434] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.535516] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.535751] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.535862] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.535918] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.536102] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.536224] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.536367] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7d14587-9c33-4f63-bdfa-4032543cd8b0 is going to be updated. [ 768.537591] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.537725] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.537964] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-782e10e2-c275-4c7b-bb67-ec47dc30cf73 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.538055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.567710] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.568264] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.569185] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.569185] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.569185] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.572113] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7d14587-9c33-4f63-bdfa-4032543cd8b0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.646675] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.870701] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 in Status: SUCCESS [ 768.871471] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.871529] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.872635] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.872635] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9117e7f6-fbaa-44a8-bc92-e3fb9acd2228',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.908811] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a41415ed-2788-44fc-9776-a1eea5a113ed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.909889] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.910047] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.910123] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.910332] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.910424] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.910714] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.910714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.910828] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.910995] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.911119] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.911212] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df799599-b9e4-4fae-8e7f-51d9f32552eb is going to be deleted. [ 768.950601] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.951637] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('876f2bba-a1aa-45c2-b7af-e384fa951e08',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.952477] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('782e10e2-c275-4c7b-bb67-ec47dc30cf73',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.955672] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.955811] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.955862] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.956603] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.956603] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.956603] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df799599-b9e4-4fae-8e7f-51d9f32552eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.957046] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df799599-b9e4-4fae-8e7f-51d9f32552eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.957046] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df799599-b9e4-4fae-8e7f-51d9f32552eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.957046] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.957617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.957617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.957617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.957617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.957617] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df799599-b9e4-4fae-8e7f-51d9f32552eb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.149131] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.149507] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.149654] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.150361] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.151416] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.151534] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ce997a4-e173-41da-a149-86945dba84fe is going to be created. [ 769.181894] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.181894] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.181894] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.181894] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.181894] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.196245] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ce997a4-e173-41da-a149-86945dba84fe in Status: UNINITIALIZED for 2s [ 769.258429] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 in Status: SUCCESS [ 769.259508] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.259508] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.261521] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.261521] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.261521] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.261521] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.261521] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.261521] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.261521] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9117e7f6-fbaa-44a8-bc92-e3fb9acd2228',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.401044] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.401451] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.401451] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.401536] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.401628] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.401724] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 is going to be deleted. [ 769.413506] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a41415ed-2788-44fc-9776-a1eea5a113ed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.453956] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.454199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.454312] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.454633] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.454774] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.454917] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21deb826-26b5-4246-96bf-34da6682babd is going to be updated. [ 769.456853] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.457380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.457605] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.457912] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.458125] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.458340] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 876f2bba-a1aa-45c2-b7af-e384fa951e08 is going to be created. [ 769.460026] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.460293] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.460591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.460788] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.460990] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.461208] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 is going to be updated. [ 769.464784] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.465043] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.465233] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.465561] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.466253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.466253] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.466253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.466451] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.466717] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.467009] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.467219] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df799599-b9e4-4fae-8e7f-51d9f32552eb already deleted. [ 769.467546] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df799599-b9e4-4fae-8e7f-51d9f32552eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.467770] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df799599-b9e4-4fae-8e7f-51d9f32552eb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.471032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df799599-b9e4-4fae-8e7f-51d9f32552eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.471032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df799599-b9e4-4fae-8e7f-51d9f32552eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.472252] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.472252] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.472252] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.475961] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.476180] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.476280] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df799599-b9e4-4fae-8e7f-51d9f32552eb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.480784] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.480975] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.481118] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.481342] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.481523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.481640] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.500082] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.500259] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.500306] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.500554] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.500826] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.504074] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.504210] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.504262] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.504503] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.504749] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.514617] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 876f2bba-a1aa-45c2-b7af-e384fa951e08 in Status: UNINITIALIZED for 2s [ 769.515562] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: IN_PROGRESS for 2s [ 769.517903] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.518544] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.518544] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.518544] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.518906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.527705] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 in Status: IN_PROGRESS for 2s [ 769.767730] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.767730] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.767730] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.767730] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.767730] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.767730] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.767730] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.767730] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.767730] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.767730] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.767730] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 is going to be deleted. [ 769.819348] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.823190] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.823190] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.823190] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.823190] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.823190] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.823190] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.823190] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.823190] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.823190] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.823190] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.823190] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.823190] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.823190] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9117e7f6-fbaa-44a8-bc92-e3fb9acd2228',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.918250] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.918250] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.918250] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.918250] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.918250] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.918250] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a41415ed-2788-44fc-9776-a1eea5a113ed is going to be updated. [ 769.958116] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.958269] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.958269] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.958410] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.958559] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.972039] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a41415ed-2788-44fc-9776-a1eea5a113ed in Status: IN_PROGRESS for 2s [ 769.979619] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df799599-b9e4-4fae-8e7f-51d9f32552eb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.981135] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.981275] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.981373] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.981634] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.981747] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.981982] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.982239] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.982303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.982472] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.982581] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.982683] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df799599-b9e4-4fae-8e7f-51d9f32552eb already deleted. [ 769.982793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df799599-b9e4-4fae-8e7f-51d9f32552eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.327572] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.327834] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.327834] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.328021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.328639] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.328639] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.328639] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.328639] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.328639] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.328639] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.328936] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9117e7f6-fbaa-44a8-bc92-e3fb9acd2228 already deleted. [ 770.328936] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9117e7f6-fbaa-44a8-bc92-e3fb9acd2228" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.485020] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df799599-b9e4-4fae-8e7f-51d9f32552eb: rpc.has_security_group_logging(os_id): False [ 770.503677] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: SUCCESS [ 770.503677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.506152] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.506152] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.506152] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.506152] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.506152] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.506152] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.506152] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.506591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.506591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.506591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.506591] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df799599-b9e4-4fae-8e7f-51d9f32552eb is going to be created. [ 770.547638] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/df799599-b9e4-4fae-8e7f-51d9f32552eb], does not exist path=[/infra/domains/default/groups/df799599-b9e4-4fae-8e7f-51d9f32552eb]."\n}' [ 770.547638] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df799599-b9e4-4fae-8e7f-51d9f32552eb failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/df799599-b9e4-4fae-8e7f-51d9f32552eb [ 770.547638] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 770.613903] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.614202] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.614316] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.614698] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.616903] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.617662] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.617907] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.617907] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.618168] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.618317] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.618529] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.618643] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.618707] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.618951] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.619043] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.619143] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df799599-b9e4-4fae-8e7f-51d9f32552eb is going to be created. [ 770.645101] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/df799599-b9e4-4fae-8e7f-51d9f32552eb], does not exist path=[/infra/domains/default/groups/df799599-b9e4-4fae-8e7f-51d9f32552eb]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/df799599-b9e4-4fae-8e7f-51d9f32552eb [ 770.645310] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df799599-b9e4-4fae-8e7f-51d9f32552eb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.646241] env[66834]: Traceback (most recent call last): [ 770.646241] env[66834]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 770.646241] env[66834]: return func(*args, **kwargs) [ 770.646241] env[66834]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 770.646241] env[66834]: res.raise_for_status() [ 770.646241] env[66834]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 770.646241] env[66834]: raise HTTPError(http_error_msg, response=self) [ 770.646241] env[66834]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/df799599-b9e4-4fae-8e7f-51d9f32552eb [ 770.646241] env[66834]: During handling of the above exception, another exception occurred: [ 770.646241] env[66834]: Traceback (most recent call last): [ 770.646241] env[66834]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 770.646241] env[66834]: listener.cb(fileno) [ 770.646241] env[66834]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 770.646241] env[66834]: result = function(*args, **kwargs) [ 770.646241] env[66834]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 770.646241] env[66834]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 770.646241] env[66834]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 770.646241] env[66834]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 770.646241] env[66834]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 770.646241] env[66834]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 770.646241] env[66834]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 770.646241] env[66834]: res.raise_for_status() [ 770.646241] env[66834]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 770.646241] env[66834]: raise HTTPError(http_error_msg, response=self) [ 770.646241] env[66834]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/df799599-b9e4-4fae-8e7f-51d9f32552eb [ 770.646241] env[66834]: Removing descriptor: 23 [ 771.109477] env[66834]: INFO networking_nsxv3.common.synchronization [req-09e5c901-abe7-4a88-af7d-46cf268c1a14 req-3ff027bb-64fe-4621-bb6b-b32d19b7750d tempest-ListServerFiltersTestJSON-1401422689 tempest-ListServerFiltersTestJSON-1401422689-project-member] Enqueued Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGHEST for action security_group_members [ 771.111748] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGHEST for action security_group_members [ 771.111748] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.111901] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.210657] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ce997a4-e173-41da-a149-86945dba84fe in Status: SUCCESS [ 771.210861] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.214842] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.216865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.216865] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.217384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.217461] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.217845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.217954] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.218153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.218232] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.220055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.220649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.223416] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.223416] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.223416] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.223416] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.223416] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.223416] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.530783] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 876f2bba-a1aa-45c2-b7af-e384fa951e08 in Status: SUCCESS [ 771.531157] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-876f2bba-a1aa-45c2-b7af-e384fa951e08" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.531225] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-876f2bba-a1aa-45c2-b7af-e384fa951e08" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.531407] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-876f2bba-a1aa-45c2-b7af-e384fa951e08" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.531597] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.531716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.531783] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.531939] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.532024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.534116] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('876f2bba-a1aa-45c2-b7af-e384fa951e08',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.535765] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: SUCCESS [ 771.535958] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.536519] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.536912] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.537156] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.537284] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.537351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.537795] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.538236] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.538348] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.543714] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-437 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.543908] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-437" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.544045] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-437" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.544368] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-437" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.544652] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.544808] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.544919] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.545440] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.545440] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.545578] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 771.545762] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 771.545878] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 771.546011] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 771.546144] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 771.546257] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 771.546386] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 771.549733] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 in Status: SUCCESS [ 771.549733] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.551568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.551568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.551568] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.551568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.551568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.551568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.551568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.551568] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('782e10e2-c275-4c7b-bb67-ec47dc30cf73',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.576954] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 771.577963] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 771.577963] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 771.577963] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-437" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.578866] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-9d4abbe7-f454-4ab3-a1be-2fc3863f0b53 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.578866] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-9d4abbe7-f454-4ab3-a1be-2fc3863f0b53" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.579580] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-9d4abbe7-f454-4ab3-a1be-2fc3863f0b53" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.579580] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-9d4abbe7-f454-4ab3-a1be-2fc3863f0b53" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.579580] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d4abbe7-f454-4ab3-a1be-2fc3863f0b53',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.725205] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.725205] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.729367] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.985096] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a41415ed-2788-44fc-9776-a1eea5a113ed in Status: SUCCESS [ 771.985439] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.985635] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.985980] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.986297] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.986508] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.986603] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.986793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.986956] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.987107] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.987193] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a41415ed-2788-44fc-9776-a1eea5a113ed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.988108] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.988281] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.988474] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.988586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.988659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.988814] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.988952] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.989031] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a41415ed-2788-44fc-9776-a1eea5a113ed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.040877] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('876f2bba-a1aa-45c2-b7af-e384fa951e08',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.041928] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.054998] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('782e10e2-c275-4c7b-bb67-ec47dc30cf73',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.084706] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.084706] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.084706] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.084706] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.084706] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.084706] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 9d4abbe7-f454-4ab3-a1be-2fc3863f0b53 not found, creating... [ 772.084706] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.084706] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.084706] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.084706] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.084706] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.085617] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.085617] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.085617] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.085617] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.085617] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.085617] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 9d4abbe7-f454-4ab3-a1be-2fc3863f0b53 is going to be created. [ 772.116742] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.117494] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.117494] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.117643] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.117831] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.118164] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-9d4abbe7-f454-4ab3-a1be-2fc3863f0b53" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.232388] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.490613] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a41415ed-2788-44fc-9776-a1eea5a113ed taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.490784] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.490959] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a41415ed-2788-44fc-9776-a1eea5a113ed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.544536] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('876f2bba-a1aa-45c2-b7af-e384fa951e08',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.544727] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.556311] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('782e10e2-c275-4c7b-bb67-ec47dc30cf73',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.734935] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.735467] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.735467] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.735467] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.735467] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.735687] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ce997a4-e173-41da-a149-86945dba84fe is going to be updated. [ 772.770993] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.771592] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.771592] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.771765] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.771765] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.785318] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ce997a4-e173-41da-a149-86945dba84fe in Status: IN_PROGRESS for 2s [ 772.876943] env[66834]: INFO networking_nsxv3.common.synchronization [req-09e5c901-abe7-4a88-af7d-46cf268c1a14 req-69c11013-2d60-413d-8ede-b626b6b44fcf service nova] Enqueued Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGHEST for action security_group_rules [ 772.876943] env[66834]: INFO networking_nsxv3.common.synchronization [req-09e5c901-abe7-4a88-af7d-46cf268c1a14 req-69c11013-2d60-413d-8ede-b626b6b44fcf service nova] Enqueued Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGHEST for action security_group_members [ 772.876943] env[66834]: INFO networking_nsxv3.common.synchronization [req-09e5c901-abe7-4a88-af7d-46cf268c1a14 req-69c11013-2d60-413d-8ede-b626b6b44fcf service nova] Enqueued Resource ID: 9d4abbe7-f454-4ab3-a1be-2fc3863f0b53 with Priority: HIGHEST for action port [ 772.877876] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGHEST for action security_group_rules [ 772.877876] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGHEST for action security_group_members [ 772.877876] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d4abbe7-f454-4ab3-a1be-2fc3863f0b53 with Priority: HIGHEST for action port [ 772.877876] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.878190] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.879081] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.879081] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.880059] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d4abbe7-f454-4ab3-a1be-2fc3863f0b53 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.880059] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d4abbe7-f454-4ab3-a1be-2fc3863f0b53" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.880059] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d4abbe7-f454-4ab3-a1be-2fc3863f0b53" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.880059] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d4abbe7-f454-4ab3-a1be-2fc3863f0b53" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.880059] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d4abbe7-f454-4ab3-a1be-2fc3863f0b53',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.992840] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a41415ed-2788-44fc-9776-a1eea5a113ed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.049027] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.049027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.049027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.049027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.049027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.049027] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 876f2bba-a1aa-45c2-b7af-e384fa951e08 is going to be updated. [ 773.049027] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.049027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.049027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.049027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.049027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.049027] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21deb826-26b5-4246-96bf-34da6682babd is going to be updated. [ 773.060472] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.061370] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.061473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.061771] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.061870] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.061984] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 is going to be updated. [ 773.096023] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.096023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.096023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.096023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.096023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.098235] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.098637] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.098637] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.098744] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.098829] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.101403] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.101561] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.101655] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.101966] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.102073] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.116820] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 876f2bba-a1aa-45c2-b7af-e384fa951e08 in Status: IN_PROGRESS for 2s [ 773.121832] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 in Status: IN_PROGRESS for 2s [ 773.122732] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: IN_PROGRESS for 2s [ 773.162060] env[66834]: INFO networking_nsxv3.common.synchronization [req-1c20913f-ba04-430e-b42c-50e67acdaa76 req-2c75eea5-b5f9-457c-852b-72878518e24f tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 with Priority: HIGHEST for action security_group_members [ 773.162060] env[66834]: INFO networking_nsxv3.common.synchronization [req-1c20913f-ba04-430e-b42c-50e67acdaa76 req-2c75eea5-b5f9-457c-852b-72878518e24f tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 876f2bba-a1aa-45c2-b7af-e384fa951e08 with Priority: HIGHEST for action security_group_members [ 773.162060] env[66834]: INFO networking_nsxv3.common.synchronization [req-1c20913f-ba04-430e-b42c-50e67acdaa76 req-2c75eea5-b5f9-457c-852b-72878518e24f tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 773.162060] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 with Priority: HIGHEST for action security_group_members [ 773.162060] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 876f2bba-a1aa-45c2-b7af-e384fa951e08 with Priority: HIGHEST for action security_group_members [ 773.162060] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 773.162726] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-782e10e2-c275-4c7b-bb67-ec47dc30cf73 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.162726] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.162726] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-876f2bba-a1aa-45c2-b7af-e384fa951e08 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.162913] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-876f2bba-a1aa-45c2-b7af-e384fa951e08" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.162913] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.163053] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.384312] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d4abbe7-f454-4ab3-a1be-2fc3863f0b53 with status ACTIVE [ 773.384481] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.384639] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.384769] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.385309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.386030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.386030] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.386030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.386281] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.386525] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.386739] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.387122] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.387264] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.387312] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.387941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.387941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.387941] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d4abbe7-f454-4ab3-a1be-2fc3863f0b53 is going to be updated. [ 773.416989] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.417285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.417400] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.417708] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.417922] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.418181] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d4abbe7-f454-4ab3-a1be-2fc3863f0b53" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.499379] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.499542] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.499615] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.499843] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.499958] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.500108] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a41415ed-2788-44fc-9776-a1eea5a113ed is going to be updated. [ 773.555120] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.555441] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.555480] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.555698] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.555856] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.569758] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a41415ed-2788-44fc-9776-a1eea5a113ed in Status: IN_PROGRESS for 2s [ 773.809120] env[66834]: INFO networking_nsxv3.common.synchronization [req-b8acbb93-ea81-41f3-b447-34d86ce992a8 req-fa8d2d29-21da-477c-9a79-2b7e50781303 tempest-MigrationsAdminTest-1673437967 tempest-MigrationsAdminTest-1673437967-project-member] Enqueued Resource ID: f46326b4-7843-4c05-8eca-cb73edd99c30 with Priority: HIGHEST for action security_group_members [ 773.809978] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f46326b4-7843-4c05-8eca-cb73edd99c30 with Priority: HIGHEST for action security_group_members [ 773.810905] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-f46326b4-7843-4c05-8eca-cb73edd99c30 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.810905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.810905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.811145] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.811145] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.811230] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.811294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.811626] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.811626] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.811723] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f46326b4-7843-4c05-8eca-cb73edd99c30',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.226204] env[66834]: INFO networking_nsxv3.common.synchronization [None req-bd3a263a-4aeb-4713-979f-7f2576d07027 tempest-ServerActionsTestJSON-2105447671 tempest-ServerActionsTestJSON-2105447671-project-member] Enqueued Resource ID: b372a601-425a-4557-bfbf-2682fc337d0d with Priority: HIGHEST for action security_group_rules [ 774.227035] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b372a601-425a-4557-bfbf-2682fc337d0d with Priority: HIGHEST for action security_group_rules [ 774.227616] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b372a601-425a-4557-bfbf-2682fc337d0d taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.227757] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.227870] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.228301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.228978] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b372a601-425a-4557-bfbf-2682fc337d0d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.319407] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f46326b4-7843-4c05-8eca-cb73edd99c30',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.382074] env[66834]: INFO networking_nsxv3.common.synchronization [None req-503c120a-3a8c-458a-b426-80cea5588a15 tempest-ServerActionsTestJSON-2105447671 tempest-ServerActionsTestJSON-2105447671-project-member] Enqueued Resource ID: b372a601-425a-4557-bfbf-2682fc337d0d with Priority: HIGHEST for action security_group_rules [ 774.382996] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b372a601-425a-4557-bfbf-2682fc337d0d with Priority: HIGHEST for action security_group_rules [ 774.384987] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b372a601-425a-4557-bfbf-2682fc337d0d taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.384987] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.430098] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-582 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.430296] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.430413] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.430680] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.430933] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.431108] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.431256] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.431455] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.431638] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.431938] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 774.432067] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 774.432173] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 774.432272] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 774.432705] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 774.432705] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 774.432705] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 774.461268] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 774.462131] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 774.462459] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 774.462739] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.463720] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-479dab71-5318-4f01-b7a8-a4239ec52016 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.463720] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-479dab71-5318-4f01-b7a8-a4239ec52016" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.463720] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-479dab71-5318-4f01-b7a8-a4239ec52016" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.464324] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-479dab71-5318-4f01-b7a8-a4239ec52016" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.464583] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('479dab71-5318-4f01-b7a8-a4239ec52016',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.756200] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.758716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.758716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.758716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.758716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.758716] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b372a601-425a-4557-bfbf-2682fc337d0d already deleted. [ 774.758716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.758716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.758716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.758716] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b372a601-425a-4557-bfbf-2682fc337d0d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.799027] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ce997a4-e173-41da-a149-86945dba84fe in Status: SUCCESS [ 774.799027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.799027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.799027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.799027] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.799027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.799027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.799027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.799027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.799027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.799027] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.799027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.799027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.799027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.799027] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.799027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.799027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.799027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.799027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.799862] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.800096] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.801094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.801477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.801731] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.801941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.802112] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.802327] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.802483] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.802639] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.822048] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f46326b4-7843-4c05-8eca-cb73edd99c30',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.969532] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.969532] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.969532] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.969821] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.969898] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.970189] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 479dab71-5318-4f01-b7a8-a4239ec52016 not found, creating... [ 774.970520] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.970700] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.970845] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.971124] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.971271] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.971584] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.971746] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.971868] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.972156] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.972301] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.972480] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 479dab71-5318-4f01-b7a8-a4239ec52016 is going to be created. [ 774.994182] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.994182] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.994182] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.994471] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.994512] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.994827] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-479dab71-5318-4f01-b7a8-a4239ec52016" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.128662] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 876f2bba-a1aa-45c2-b7af-e384fa951e08 in Status: SUCCESS [ 775.128885] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-876f2bba-a1aa-45c2-b7af-e384fa951e08" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.129199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-876f2bba-a1aa-45c2-b7af-e384fa951e08" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.129442] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-876f2bba-a1aa-45c2-b7af-e384fa951e08" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.129636] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.129783] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.129886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.129996] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.130092] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.130176] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-876f2bba-a1aa-45c2-b7af-e384fa951e08" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.130278] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('876f2bba-a1aa-45c2-b7af-e384fa951e08',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.131366] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-876f2bba-a1aa-45c2-b7af-e384fa951e08" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.131506] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-876f2bba-a1aa-45c2-b7af-e384fa951e08" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.131691] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.131804] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.131883] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.132014] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.132100] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.132198] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('876f2bba-a1aa-45c2-b7af-e384fa951e08',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.134928] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 in Status: SUCCESS [ 775.135041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.135199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.135392] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.135579] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.135715] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.135778] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.136405] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.136405] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.136405] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.136405] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('782e10e2-c275-4c7b-bb67-ec47dc30cf73',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.137837] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: SUCCESS [ 775.138161] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.138251] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.138373] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.139134] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.139134] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.139134] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.139134] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.139134] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.139134] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('782e10e2-c275-4c7b-bb67-ec47dc30cf73',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.140031] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.140191] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.140363] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.140473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.140534] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.140673] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.140750] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.140915] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.141506] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.142153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.142645] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.142645] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.142645] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.142645] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.142862] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.142862] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.142934] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.279890] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.280696] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.280696] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.280930] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.280930] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.281121] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b372a601-425a-4557-bfbf-2682fc337d0d already deleted. [ 775.281196] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.304933] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ce997a4-e173-41da-a149-86945dba84fe: rpc.has_security_group_logging(os_id): False [ 775.308068] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.325474] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.325667] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.325769] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.326035] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.326158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.326264] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f46326b4-7843-4c05-8eca-cb73edd99c30 is going to be updated. [ 775.329712] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.329712] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.329712] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.329712] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.329712] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.330046] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.330046] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.330046] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.330195] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.330195] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.330413] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.330512] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.330588] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.330761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.330831] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.331062] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.331164] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.331220] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.331389] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.331489] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.331579] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ce997a4-e173-41da-a149-86945dba84fe is going to be created. [ 775.371450] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.371450] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.371727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.371727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.372308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.383084] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f46326b4-7843-4c05-8eca-cb73edd99c30 in Status: IN_PROGRESS for 2s [ 775.414241] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.414241] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.414241] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.414241] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.415108] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.431825] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ce997a4-e173-41da-a149-86945dba84fe in Status: IN_PROGRESS for 2s [ 775.590023] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a41415ed-2788-44fc-9776-a1eea5a113ed in Status: SUCCESS [ 775.590023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.590023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.590023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.590023] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.590023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.590326] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.590326] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.592111] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.592111] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a41415ed-2788-44fc-9776-a1eea5a113ed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.635731] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('876f2bba-a1aa-45c2-b7af-e384fa951e08',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.637030] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.637030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.637030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.637260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.637260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.637401] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.637524] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.637614] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.637778] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.637881] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.637983] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 876f2bba-a1aa-45c2-b7af-e384fa951e08 is going to be deleted. [ 775.642418] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('782e10e2-c275-4c7b-bb67-ec47dc30cf73',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.643696] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.644049] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.644161] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.644504] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.647797] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.647915] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.648168] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.679427] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.679715] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.679879] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.679978] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.680257] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.680409] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.680528] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 is going to be updated. [ 775.706018] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.706494] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.706586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.707070] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.707195] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.707344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-876f2bba-a1aa-45c2-b7af-e384fa951e08" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.732648] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.732648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.732648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.732648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.732648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.744761] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 in Status: IN_PROGRESS for 2s [ 775.812685] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.836785] env[66834]: INFO networking_nsxv3.common.synchronization [req-b8acbb93-ea81-41f3-b447-34d86ce992a8 req-f5591a59-a96a-4409-b171-ec62eb859846 service nova] Enqueued Resource ID: f46326b4-7843-4c05-8eca-cb73edd99c30 with Priority: HIGHEST for action security_group_rules [ 775.836785] env[66834]: INFO networking_nsxv3.common.synchronization [req-b8acbb93-ea81-41f3-b447-34d86ce992a8 req-f5591a59-a96a-4409-b171-ec62eb859846 service nova] Enqueued Resource ID: f46326b4-7843-4c05-8eca-cb73edd99c30 with Priority: HIGHEST for action security_group_members [ 775.836785] env[66834]: INFO networking_nsxv3.common.synchronization [req-b8acbb93-ea81-41f3-b447-34d86ce992a8 req-f5591a59-a96a-4409-b171-ec62eb859846 service nova] Enqueued Resource ID: 479dab71-5318-4f01-b7a8-a4239ec52016 with Priority: HIGHEST for action port [ 775.836785] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f46326b4-7843-4c05-8eca-cb73edd99c30 with Priority: HIGHEST for action security_group_rules [ 775.836785] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f46326b4-7843-4c05-8eca-cb73edd99c30 with Priority: HIGHEST for action security_group_members [ 775.836785] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479dab71-5318-4f01-b7a8-a4239ec52016 with Priority: HIGHEST for action port [ 775.842077] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f46326b4-7843-4c05-8eca-cb73edd99c30 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.842077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.842077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.842077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.842077] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f46326b4-7843-4c05-8eca-cb73edd99c30',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.842077] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-f46326b4-7843-4c05-8eca-cb73edd99c30 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.842077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.842408] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-479dab71-5318-4f01-b7a8-a4239ec52016 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.842408] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-479dab71-5318-4f01-b7a8-a4239ec52016" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.842408] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-479dab71-5318-4f01-b7a8-a4239ec52016" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.843955] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-479dab71-5318-4f01-b7a8-a4239ec52016" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.843955] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('479dab71-5318-4f01-b7a8-a4239ec52016',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.092939] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a41415ed-2788-44fc-9776-a1eea5a113ed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.111718] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.111906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.111965] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.112207] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.112317] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.142289] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 876f2bba-a1aa-45c2-b7af-e384fa951e08: rpc.has_security_group_logging(os_id): False [ 776.148319] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 782e10e2-c275-4c7b-bb67-ec47dc30cf73: rpc.has_security_group_logging(os_id): False [ 776.150865] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.164845] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.164845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.164845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.164845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.164845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.165127] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.165234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.165298] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.165462] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.165537] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.165624] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 876f2bba-a1aa-45c2-b7af-e384fa951e08 is going to be created. [ 776.168017] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.168151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.168221] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.168426] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.168516] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.168721] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.168819] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.168880] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.169081] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.169185] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.169275] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 is going to be updated. [ 776.198349] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/876f2bba-a1aa-45c2-b7af-e384fa951e08], does not exist path=[/infra/domains/default/groups/876f2bba-a1aa-45c2-b7af-e384fa951e08]."\n}' [ 776.198349] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 876f2bba-a1aa-45c2-b7af-e384fa951e08 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/876f2bba-a1aa-45c2-b7af-e384fa951e08 [ 776.198440] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 776.251215] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.251372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.251440] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.251664] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.252782] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.253637] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.253637] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.253637] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.253637] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.253637] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.253946] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.253946] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.254151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.254323] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.254454] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.254560] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 876f2bba-a1aa-45c2-b7af-e384fa951e08 is going to be created. [ 776.271935] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.271935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.271935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.271935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.271935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.279763] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/876f2bba-a1aa-45c2-b7af-e384fa951e08], does not exist path=[/infra/domains/default/groups/876f2bba-a1aa-45c2-b7af-e384fa951e08]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/876f2bba-a1aa-45c2-b7af-e384fa951e08 [ 776.279959] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-876f2bba-a1aa-45c2-b7af-e384fa951e08" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.280198] env[66834]: Traceback (most recent call last): [ 776.280261] env[66834]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 776.280261] env[66834]: return func(*args, **kwargs) [ 776.280261] env[66834]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 776.280261] env[66834]: res.raise_for_status() [ 776.280261] env[66834]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 776.280261] env[66834]: raise HTTPError(http_error_msg, response=self) [ 776.280261] env[66834]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/876f2bba-a1aa-45c2-b7af-e384fa951e08 [ 776.280261] env[66834]: During handling of the above exception, another exception occurred: [ 776.280261] env[66834]: Traceback (most recent call last): [ 776.280261] env[66834]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 776.280261] env[66834]: listener.cb(fileno) [ 776.280261] env[66834]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 776.280261] env[66834]: result = function(*args, **kwargs) [ 776.280261] env[66834]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 776.280261] env[66834]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 776.280261] env[66834]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 776.280261] env[66834]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 776.280261] env[66834]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 776.280261] env[66834]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 776.280261] env[66834]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 776.280261] env[66834]: res.raise_for_status() [ 776.280261] env[66834]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 776.280261] env[66834]: raise HTTPError(http_error_msg, response=self) [ 776.280261] env[66834]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/876f2bba-a1aa-45c2-b7af-e384fa951e08 [ 776.281081] env[66834]: Removing descriptor: 23 [ 776.300836] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 in Status: IN_PROGRESS for 2s [ 776.316185] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.316459] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.316459] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.316642] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.316798] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.316982] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ce997a4-e173-41da-a149-86945dba84fe is going to be updated. [ 776.346318] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-f46326b4-7843-4c05-8eca-cb73edd99c30 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.346501] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.346710] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 479dab71-5318-4f01-b7a8-a4239ec52016 with status ACTIVE [ 776.346888] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.347030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.347127] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.347414] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.347540] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.347746] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.347846] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.347905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.348090] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.348172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.348421] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.348545] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.348607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.348759] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.348837] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.348996] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 479dab71-5318-4f01-b7a8-a4239ec52016 is going to be updated. [ 776.385718] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.385882] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.385968] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.386423] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.386573] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.386769] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-479dab71-5318-4f01-b7a8-a4239ec52016" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.425542] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.425694] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.425807] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.426104] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.426335] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.443396] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ce997a4-e173-41da-a149-86945dba84fe in Status: IN_PROGRESS for 2s [ 776.595142] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a41415ed-2788-44fc-9776-a1eea5a113ed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.614929] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.653941] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.653941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.654214] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.654251] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.654342] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.654469] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21deb826-26b5-4246-96bf-34da6682babd is going to be updated. [ 776.712361] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.712533] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.712605] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.712840] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.713020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.730705] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: IN_PROGRESS for 2s [ 777.098016] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.098483] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.098483] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.098483] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.098615] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.098663] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a41415ed-2788-44fc-9776-a1eea5a113ed is going to be updated. [ 777.117687] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.137635] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.137856] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.137856] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.138415] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.138415] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.152068] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a41415ed-2788-44fc-9776-a1eea5a113ed in Status: IN_PROGRESS for 2s [ 777.393654] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f46326b4-7843-4c05-8eca-cb73edd99c30 in Status: SUCCESS [ 777.393916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.394170] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.394437] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.394622] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.394791] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.394860] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.395046] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.395137] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.395266] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f46326b4-7843-4c05-8eca-cb73edd99c30',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.446559] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ce997a4-e173-41da-a149-86945dba84fe in Status: SUCCESS [ 777.446797] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.447064] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.447426] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.447520] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.622178] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 777.622178] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 777.768905] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 in Status: SUCCESS [ 777.769253] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 deletion is rescheduled due to dependency. [ 777.769388] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.897840] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f46326b4-7843-4c05-8eca-cb73edd99c30',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.950564] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.950564] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.320299] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 in Status: SUCCESS [ 778.320299] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.399370] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f46326b4-7843-4c05-8eca-cb73edd99c30',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.461735] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ce997a4-e173-41da-a149-86945dba84fe in Status: SUCCESS [ 778.462018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.462269] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.462459] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.462853] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.462853] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.462853] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.463294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.463294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.463294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.463391] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.621186] env[66834]: INFO networking_nsxv3.common.synchronization [req-0bf51306-06c2-4013-aa54-89bc28f6907f req-6dd4dccd-540b-46e8-91e4-b185ad046f28 tempest-ServerRescueTestJSONUnderV235-1924768781 tempest-ServerRescueTestJSONUnderV235-1924768781-project-member] Enqueued Resource ID: a41415ed-2788-44fc-9776-a1eea5a113ed with Priority: HIGHEST for action security_group_members [ 778.621516] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a41415ed-2788-44fc-9776-a1eea5a113ed with Priority: HIGHEST for action security_group_members [ 778.621825] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a41415ed-2788-44fc-9776-a1eea5a113ed taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.621921] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.630389] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.630579] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.630692] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.630933] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.656799] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 778.656799] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.658488] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 778.692348] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.692529] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.692713] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.693386] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.700114] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.700761] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 778.700860] env[66834]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66834) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 778.700974] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 778.750038] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: SUCCESS [ 778.750038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.750038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.750038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.750038] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.750038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.750038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.750038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.750038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.750038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.750038] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.750038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.751060] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.751436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.752358] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.754146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.754146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.754146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.754146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.754146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.754146] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.764036] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.764036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.764036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.764036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.764036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.764821] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 778.851230] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.851454] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.851582] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.851717] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.851995] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.852364] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 778.902668] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.902871] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.902949] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.903217] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.903334] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.903450] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f46326b4-7843-4c05-8eca-cb73edd99c30 is going to be updated. [ 778.939872] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.940137] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.940137] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.940358] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.940507] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.945790] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.945990] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.945990] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.946308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.946555] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.946795] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:35. [ 778.946910] env[66834]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'386f2bfa-81a7-40ba-a9a8-a207890c2528', 'a41415ed-2788-44fc-9776-a1eea5a113ed', '9276c5a5-af43-4c6e-899f-c34039400160', 'd9115622-9b53-4106-895d-803c18358d29', 'a15c14c6-0aee-4e9d-b481-2661c510f44a', '21deb826-26b5-4246-96bf-34da6682babd', '5a725faa-03fa-4615-b825-f2c19527a60c', '8b0294dc-2245-46bf-a56e-f22fbf616a62', 'be6a78d7-b908-447c-a3f4-0f30c644939c', '01965726-b599-4a24-a0ef-beaaba998cf3', 'cb6f8ce6-311d-4e8e-b179-b86a971739cb', '3db0e155-352c-4d42-a24e-48fff17d86ac', '3ce997a4-e173-41da-a149-86945dba84fe', '9c3590f1-016a-4b00-b83e-f52f030b948b', '60ea5439-0179-41e0-a8c0-e75e739326a4', '2bf0f195-54b8-49b4-bd78-a433a8df0ce0', '4cdb75fc-c0b5-4b9d-843f-f2ae58af6997', '240d0ecb-120a-48a6-aeb4-265ef374eeb1', 'b11bc7eb-c1bb-49d4-8347-38576752a094', '599d582a-c0d7-4df7-a1fe-3e63412d8939', '782e10e2-c275-4c7b-bb67-ec47dc30cf73', '1262896d-5f2c-4d6b-8695-adeea78ba3f6', '06251551-417e-4f8a-9412-fdb5036f57fe', 'a4da628c-f2f0-417c-917f-a8cc4350870b', 'c40be9d7-369b-4cf1-88e7-d822d62fa7f1', '98a1f729-8e05-4426-8db7-2c883443f0e8', '8ef26513-917e-4754-b69d-1d511bcb585b', '7b33fa48-b9ca-426c-b890-67d4639035e2', '659c3ecb-b49f-4d7f-8978-4e0221530e96', '6b93eb01-51cc-4c25-b2fa-56b4a62620d3', '06c1d39f-c76e-47c4-9900-046863c4e37a', 'f46326b4-7843-4c05-8eca-cb73edd99c30', '61dc46c7-365b-480f-83e5-16cbc578a879', '4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4', '7963c125-23b5-45fd-8158-f6470d12949e'} {{(pid=66834) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 778.947038] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 778.953987] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f46326b4-7843-4c05-8eca-cb73edd99c30 in Status: IN_PROGRESS for 2s [ 778.966871] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.967447] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.967581] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.967839] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.968130] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.968280] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.968383] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.968525] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.968743] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.968834] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.969050] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.969189] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.969290] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.969485] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.969652] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.969793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.969876] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.970283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.970395] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.970484] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.970563] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.975976] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.976258] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.976345] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.976536] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.976632] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.976764] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 778.976990] env[66834]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66834) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 778.976990] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 779.060585] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.060758] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.060841] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.061166] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.062040] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.062333] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 779.062420] env[66834]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66834) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 779.062492] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 779.062541] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 779.062616] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/35 resources of Type:Security Group Rules [ 779.062706] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 with Priority: HIGH for action security_group_rules [ 779.062781] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a41415ed-2788-44fc-9776-a1eea5a113ed with Priority: HIGH for action security_group_rules [ 779.062891] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGH for action security_group_rules [ 779.063029] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d9115622-9b53-4106-895d-803c18358d29 with Priority: HIGH for action security_group_rules [ 779.063150] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGH for action security_group_rules [ 779.063268] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGH for action security_group_rules [ 779.063386] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5a725faa-03fa-4615-b825-f2c19527a60c with Priority: HIGH for action security_group_rules [ 779.063472] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 with Priority: HIGH for action security_group_rules [ 779.063535] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: be6a78d7-b908-447c-a3f4-0f30c644939c with Priority: HIGH for action security_group_rules [ 779.063590] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 01965726-b599-4a24-a0ef-beaaba998cf3 with Priority: HIGH for action security_group_rules [ 779.063653] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cb6f8ce6-311d-4e8e-b179-b86a971739cb with Priority: HIGH for action security_group_rules [ 779.063704] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3db0e155-352c-4d42-a24e-48fff17d86ac with Priority: HIGH for action security_group_rules [ 779.063761] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGH for action security_group_rules [ 779.063815] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9c3590f1-016a-4b00-b83e-f52f030b948b with Priority: HIGH for action security_group_rules [ 779.063870] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 60ea5439-0179-41e0-a8c0-e75e739326a4 with Priority: HIGH for action security_group_rules [ 779.063949] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2bf0f195-54b8-49b4-bd78-a433a8df0ce0 with Priority: HIGH for action security_group_rules [ 779.064114] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGH for action security_group_rules [ 779.064114] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 240d0ecb-120a-48a6-aeb4-265ef374eeb1 with Priority: HIGH for action security_group_rules [ 779.064204] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b11bc7eb-c1bb-49d4-8347-38576752a094 with Priority: HIGH for action security_group_rules [ 779.064204] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGH for action security_group_rules [ 779.064312] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.163116] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a41415ed-2788-44fc-9776-a1eea5a113ed in Status: SUCCESS [ 779.163437] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.163648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.163869] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.164077] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.164202] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.164299] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.164413] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.164489] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.164573] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.164733] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a41415ed-2788-44fc-9776-a1eea5a113ed taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.164810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.164868] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.165040] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.165184] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.165275] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.165334] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.165474] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.165567] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.165645] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.165731] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a41415ed-2788-44fc-9776-a1eea5a113ed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.166606] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.166789] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.166993] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.167087] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.167169] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.167256] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.167305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.167390] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a41415ed-2788-44fc-9776-a1eea5a113ed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.256255] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21deb826-26b5-4246-96bf-34da6682babd: rpc.has_security_group_logging(os_id): False [ 779.276198] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.276458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.276458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.276728] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.297901] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.298602] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.298778] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.298863] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.299200] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.299355] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.299512] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.299645] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.299777] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.300016] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.300150] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.300269] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.300372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.300430] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.300820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.300820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.300820] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21deb826-26b5-4246-96bf-34da6682babd is going to be updated. [ 779.383354] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.383706] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.383706] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.383777] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.383968] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.407512] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: IN_PROGRESS for 2s [ 779.475656] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ce997a4-e173-41da-a149-86945dba84fe: rpc.has_security_group_logging(os_id): False [ 779.508504] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.508682] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.511122] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.511122] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.544828] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.545147] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.545289] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.545364] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.545641] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.545848] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.546114] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.546261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.546369] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.546647] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.546786] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.547150] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.547295] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.547390] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.547616] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.547735] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.547828] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ce997a4-e173-41da-a149-86945dba84fe is going to be updated. [ 779.627821] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.628074] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.628222] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.628532] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.628787] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.642232] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ce997a4-e173-41da-a149-86945dba84fe in Status: IN_PROGRESS for 2s [ 779.671066] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a41415ed-2788-44fc-9776-a1eea5a113ed: rpc.has_security_group_logging(os_id): False [ 779.672163] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.672375] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.672470] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.672694] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.713304] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.713534] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.721688] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.721887] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.722032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.722104] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.722324] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.722442] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.722502] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a41415ed-2788-44fc-9776-a1eea5a113ed is going to be updated. [ 779.724279] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.724279] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.724435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.724720] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.724720] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.724817] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.724945] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.725012] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.725180] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.725281] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.725456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.725534] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.725595] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.725819] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.725923] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.725977] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.726139] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.726214] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.726303] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a41415ed-2788-44fc-9776-a1eea5a113ed is going to be updated. [ 779.786338] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.786525] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.786622] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.786998] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.787223] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.822130] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a41415ed-2788-44fc-9776-a1eea5a113ed in Status: IN_PROGRESS for 2s [ 779.869499] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.869725] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.869725] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.870040] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.870159] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.889861] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a41415ed-2788-44fc-9776-a1eea5a113ed in Status: IN_PROGRESS for 2s [ 780.967180] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f46326b4-7843-4c05-8eca-cb73edd99c30 in Status: SUCCESS [ 780.967542] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.967542] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.969204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.969204] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.969204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.969204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.969204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.969204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.969204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.969204] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f46326b4-7843-4c05-8eca-cb73edd99c30',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.451220] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: SUCCESS [ 781.451220] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.471853] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-f46326b4-7843-4c05-8eca-cb73edd99c30 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.472101] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.472101] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.472385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.472537] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.472640] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.472702] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.472866] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.472953] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.473059] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.473222] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-f46326b4-7843-4c05-8eca-cb73edd99c30 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.473317] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.473363] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.473503] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.473642] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.473733] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.473793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.473932] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.474021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.474108] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.474203] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f46326b4-7843-4c05-8eca-cb73edd99c30',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.655796] env[66834]: INFO networking_nsxv3.common.synchronization [req-15dcaebb-70f6-4bc6-9cbd-69ecc46bc8e3 req-2d658f9e-8737-48e6-b66f-3f416023d9f0 tempest-ServersAdminNegativeTestJSON-1367226242 tempest-ServersAdminNegativeTestJSON-1367226242-project-member] Enqueued Resource ID: 06c1d39f-c76e-47c4-9900-046863c4e37a with Priority: HIGHEST for action security_group_members [ 781.656502] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06c1d39f-c76e-47c4-9900-046863c4e37a with Priority: HIGHEST for action security_group_members [ 781.656658] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 with Priority: HIGH for action security_group_rules [ 781.657137] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGH for action security_group_rules [ 781.657279] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a725faa-03fa-4615-b825-f2c19527a60c with Priority: HIGH for action security_group_rules [ 781.657445] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60ea5439-0179-41e0-a8c0-e75e739326a4 with Priority: HIGH for action security_group_rules [ 781.657543] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGH for action security_group_rules [ 781.657914] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b11bc7eb-c1bb-49d4-8347-38576752a094 with Priority: HIGH for action security_group_rules [ 781.657914] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 240d0ecb-120a-48a6-aeb4-265ef374eeb1 with Priority: HIGH for action security_group_rules [ 781.658072] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGH for action security_group_rules [ 781.658173] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c3590f1-016a-4b00-b83e-f52f030b948b with Priority: HIGH for action security_group_rules [ 781.658291] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bf0f195-54b8-49b4-bd78-a433a8df0ce0 with Priority: HIGH for action security_group_rules [ 781.658451] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGH for action security_group_rules [ 781.658616] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3db0e155-352c-4d42-a24e-48fff17d86ac with Priority: HIGH for action security_group_rules [ 781.658787] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb6f8ce6-311d-4e8e-b179-b86a971739cb with Priority: HIGH for action security_group_rules [ 781.658956] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01965726-b599-4a24-a0ef-beaaba998cf3 with Priority: HIGH for action security_group_rules [ 781.659213] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be6a78d7-b908-447c-a3f4-0f30c644939c with Priority: HIGH for action security_group_rules [ 781.659396] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGH for action security_group_rules [ 781.659615] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 with Priority: HIGH for action security_group_rules [ 781.659754] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGH for action security_group_rules [ 781.659854] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a41415ed-2788-44fc-9776-a1eea5a113ed with Priority: HIGH for action security_group_rules [ 781.660023] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9115622-9b53-4106-895d-803c18358d29 with Priority: HIGH for action security_group_rules [ 781.660385] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06c1d39f-c76e-47c4-9900-046863c4e37a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.660542] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.660777] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.660968] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.661165] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.661354] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.661466] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.661742] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.661934] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.662021] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06c1d39f-c76e-47c4-9900-046863c4e37a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.662962] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-386f2bfa-81a7-40ba-a9a8-a207890c2528 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.663103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.663146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.663290] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.663358] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('386f2bfa-81a7-40ba-a9a8-a207890c2528',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.664568] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.664568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.664568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.664568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.664568] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.665232] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a725faa-03fa-4615-b825-f2c19527a60c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.665363] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.665437] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.665596] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.665596] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a725faa-03fa-4615-b825-f2c19527a60c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.666492] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60ea5439-0179-41e0-a8c0-e75e739326a4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.666632] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.666700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.666784] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.666851] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60ea5439-0179-41e0-a8c0-e75e739326a4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.667619] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.667755] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.667821] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.668087] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.668087] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.669764] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b11bc7eb-c1bb-49d4-8347-38576752a094 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.669764] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.669764] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.669764] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.669764] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b11bc7eb-c1bb-49d4-8347-38576752a094',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.670964] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-240d0ecb-120a-48a6-aeb4-265ef374eeb1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.670964] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.670964] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.670964] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.670964] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('240d0ecb-120a-48a6-aeb4-265ef374eeb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.671884] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.671992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.672075] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.672443] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.672443] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.673301] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c3590f1-016a-4b00-b83e-f52f030b948b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.673301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.673548] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.673548] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.673548] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c3590f1-016a-4b00-b83e-f52f030b948b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.674969] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bf0f195-54b8-49b4-bd78-a433a8df0ce0 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.675082] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.675082] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.676713] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.676713] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bf0f195-54b8-49b4-bd78-a433a8df0ce0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.676713] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.676713] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.676713] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3db0e155-352c-4d42-a24e-48fff17d86ac taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.676713] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.676713] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.678473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.678473] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3db0e155-352c-4d42-a24e-48fff17d86ac',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.678473] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb6f8ce6-311d-4e8e-b179-b86a971739cb taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.678473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.678473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.678473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.678473] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb6f8ce6-311d-4e8e-b179-b86a971739cb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.681714] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01965726-b599-4a24-a0ef-beaaba998cf3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.681714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.681714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.681714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.681714] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01965726-b599-4a24-a0ef-beaaba998cf3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.681714] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be6a78d7-b908-447c-a3f4-0f30c644939c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.681714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.681714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.681714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.681714] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be6a78d7-b908-447c-a3f4-0f30c644939c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.681714] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.682338] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.682338] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.682338] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.682338] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.683209] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b0294dc-2245-46bf-a56e-f22fbf616a62 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.683318] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.683699] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.683699] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.683699] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b0294dc-2245-46bf-a56e-f22fbf616a62',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.684387] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.684488] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.684565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.684692] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.684859] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.685741] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a41415ed-2788-44fc-9776-a1eea5a113ed taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.685836] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.686029] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9115622-9b53-4106-895d-803c18358d29 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.686820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.686820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.686820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.686820] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9115622-9b53-4106-895d-803c18358d29',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.690997] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ce997a4-e173-41da-a149-86945dba84fe in Status: SUCCESS [ 781.691336] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.695522] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.695793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.695882] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.889023] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.889206] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.889278] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.889494] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.889659] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.889748] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.889815] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.889953] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.890073] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.890276] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.890276] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.892014] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.892138] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.892208] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.892370] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.915047] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a41415ed-2788-44fc-9776-a1eea5a113ed in Status: SUCCESS [ 781.915270] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a41415ed-2788-44fc-9776-a1eea5a113ed deletion is rescheduled due to dependency. [ 781.915413] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.922384] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a41415ed-2788-44fc-9776-a1eea5a113ed in Status: SUCCESS [ 781.922657] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.923237] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.923490] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.923608] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a41415ed-2788-44fc-9776-a1eea5a113ed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.925872] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.925872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.931720] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.931720] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.936598] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.938028] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a725faa-03fa-4615-b825-f2c19527a60c is going to be deleted. [ 781.938028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.938273] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.971918] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.971918] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb6f8ce6-311d-4e8e-b179-b86a971739cb is going to be deleted. [ 781.973328] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.975161] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.981586] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f46326b4-7843-4c05-8eca-cb73edd99c30: rpc.has_security_group_logging(os_id): False [ 781.997742] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.997884] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bf0f195-54b8-49b4-bd78-a433a8df0ce0 is going to be deleted. [ 782.007462] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.007609] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.007609] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.008067] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.022876] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.023087] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.039414] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.039713] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.039877] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.039945] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.040201] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.040281] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.040485] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.040584] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.040696] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.040789] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.040860] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.041050] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.041134] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.041194] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.041394] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.041473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.041556] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f46326b4-7843-4c05-8eca-cb73edd99c30 is going to be updated. [ 782.043643] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.043643] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.043643] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.043643] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a725faa-03fa-4615-b825-f2c19527a60c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.066239] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.066706] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.066706] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.066820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.066890] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.067051] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb6f8ce6-311d-4e8e-b179-b86a971739cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.091438] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.091710] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.091710] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.091868] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.091926] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.092107] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bf0f195-54b8-49b4-bd78-a433a8df0ce0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.189150] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.189297] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.189342] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.189604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.190966] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.191152] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.191152] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.191357] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.191507] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.191604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.191657] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.192051] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.192051] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.192051] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.192256] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.194314] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.194314] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.194314] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-386f2bfa-81a7-40ba-a9a8-a207890c2528 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.194533] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.194533] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.194598] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.194704] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.194791] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.194850] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.194992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.195091] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.195173] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.195262] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('386f2bfa-81a7-40ba-a9a8-a207890c2528',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.201060] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.201378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.201378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.202351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.202351] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.202351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.202351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.202969] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.203086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.203187] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.203281] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.218122] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b0294dc-2245-46bf-a56e-f22fbf616a62 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.218308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.218365] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.218559] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.218726] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.218839] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.218892] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.219047] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.219137] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.219221] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.219304] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b0294dc-2245-46bf-a56e-f22fbf616a62',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.233728] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.233728] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.250935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.250935] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.250935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.250935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.250935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.250935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.250935] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06c1d39f-c76e-47c4-9900-046863c4e37a is going to be updated. [ 782.250935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.250935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.250935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.254048] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.254048] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.328796] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f46326b4-7843-4c05-8eca-cb73edd99c30 in Status: IN_PROGRESS for 2s [ 782.336477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.336686] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60ea5439-0179-41e0-a8c0-e75e739326a4 is going to be deleted. [ 782.352814] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.353127] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.353127] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.353292] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.353398] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.371395] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06c1d39f-c76e-47c4-9900-046863c4e37a in Status: IN_PROGRESS for 2s [ 782.388010] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.388274] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.388379] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.388605] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.388953] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.388953] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.389150] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.389667] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.389771] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.390109] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.390109] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.392250] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3db0e155-352c-4d42-a24e-48fff17d86ac taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.392411] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.392475] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.392689] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.392896] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.393118] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.393164] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.393554] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.393554] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.393554] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.393765] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3db0e155-352c-4d42-a24e-48fff17d86ac',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.401852] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.403568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.403568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.403568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.403568] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.403568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.403568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.403568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.403568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.403568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.403568] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.403568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.404093] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.404093] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.404093] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.404203] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.404359] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.406032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.406032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.406169] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.406221] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.412030] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-b11bc7eb-c1bb-49d4-8347-38576752a094 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.412030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.412030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.412030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.412030] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.412030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.412030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.412030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.412030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.412030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.412030] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b11bc7eb-c1bb-49d4-8347-38576752a094',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.415291] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-be6a78d7-b908-447c-a3f4-0f30c644939c taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.415464] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.415761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.415761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.415950] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.416099] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.416183] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.416350] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.416453] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.416557] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.416660] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('be6a78d7-b908-447c-a3f4-0f30c644939c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.419522] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c3590f1-016a-4b00-b83e-f52f030b948b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.419657] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.420600] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.420600] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.420600] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.420600] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.420600] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.420600] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.420600] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.420600] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.420600] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c3590f1-016a-4b00-b83e-f52f030b948b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.422114] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.422221] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.422286] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.422449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.422601] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.422716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.423900] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.423900] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.423900] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.423900] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.423900] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.425220] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21deb826-26b5-4246-96bf-34da6682babd: rpc.has_security_group_logging(os_id): False [ 782.528304] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.528469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.528535] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.528753] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.542384] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.542572] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.545151] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.545284] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.546060] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.546160] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.549553] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.549553] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.557135] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.557255] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.558084] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.558188] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.560517] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.560627] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01965726-b599-4a24-a0ef-beaaba998cf3 is going to be deleted. [ 782.561730] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.562073] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.562184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.562392] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.562548] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.562548] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.562725] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.562796] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.562993] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.563306] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.563464] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.563625] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.563700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.563899] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.563979] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.564049] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.564238] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.564351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.564485] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21deb826-26b5-4246-96bf-34da6682babd is going to be updated. [ 782.565511] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.565674] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.598206] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.598206] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 240d0ecb-120a-48a6-aeb4-265ef374eeb1 is going to be deleted. [ 782.599340] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.599583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.599673] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.599798] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60ea5439-0179-41e0-a8c0-e75e739326a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.600035] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.600675] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.639913] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.639913] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 is going to be deleted. [ 782.641880] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.642209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.642340] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.642486] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a41415ed-2788-44fc-9776-a1eea5a113ed is going to be deleted. [ 782.643778] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.644030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.666965] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.666965] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.679033] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.679033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.697947] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.698102] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.698439] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.698574] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.698643] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.698849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.699030] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.699138] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.699203] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.699366] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.699453] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.699537] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.699693] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.699787] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.699884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.700015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.700638] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.700749] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.700820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.701011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.701285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.701320] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.701432] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.704024] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('386f2bfa-81a7-40ba-a9a8-a207890c2528',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.707494] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.707633] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.707700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.710284] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.710514] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.711285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.711285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.711285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.711285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.711285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.711285] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.711643] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.711643] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.711643] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.711753] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.711753] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.711857] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.712523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.712523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.712523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.712523] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.721975] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b0294dc-2245-46bf-a56e-f22fbf616a62',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.740949] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.740949] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9115622-9b53-4106-895d-803c18358d29 is going to be deleted. [ 782.740949] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.741169] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.741169] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.741258] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01965726-b599-4a24-a0ef-beaaba998cf3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.742036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.742036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.742461] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.743636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.743822] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.743955] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.744092] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-240d0ecb-120a-48a6-aeb4-265ef374eeb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.799811] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.799937] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.799982] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.800430] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.800574] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.800658] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.801231] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.801474] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.801613] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a41415ed-2788-44fc-9776-a1eea5a113ed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.811218] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.811218] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.811421] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.812394] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.812394] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.812394] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.837736] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: IN_PROGRESS for 2s [ 782.896379] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.899414] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3db0e155-352c-4d42-a24e-48fff17d86ac',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.924228] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c3590f1-016a-4b00-b83e-f52f030b948b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.926111] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('be6a78d7-b908-447c-a3f4-0f30c644939c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.928833] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b11bc7eb-c1bb-49d4-8347-38576752a094',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.934404] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.934576] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.934576] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.934725] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.934811] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.934936] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9115622-9b53-4106-895d-803c18358d29" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.935485] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.935936] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.935936] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.935936] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.935936] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.936312] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.936312] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.936312] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.936312] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.936545] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.936545] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.936621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.936695] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.936943] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.936943] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.937075] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.938341] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.938622] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.939019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.939019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.939130] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.238663] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9276c5a5-af43-4c6e-899f-c34039400160: rpc.has_security_group_logging(os_id): False [ 783.238663] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 386f2bfa-81a7-40ba-a9a8-a207890c2528: rpc.has_security_group_logging(os_id): False [ 783.238663] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ce997a4-e173-41da-a149-86945dba84fe: rpc.has_security_group_logging(os_id): False [ 783.238663] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b0294dc-2245-46bf-a56e-f22fbf616a62: rpc.has_security_group_logging(os_id): False [ 783.238663] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.238663] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.238663] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.238663] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.238663] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.238663] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.249156] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.249345] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.250411] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.250516] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.254915] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.255226] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.255331] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.255558] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.255608] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.255665] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.255757] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 is going to be updated. [ 783.256925] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.258227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.285796] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.286153] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.286343] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.286425] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.286625] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.286738] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.286989] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.287142] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.287221] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.287418] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.287495] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.287784] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.287903] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.287986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.288153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.288233] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.288327] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9276c5a5-af43-4c6e-899f-c34039400160 is going to be updated. [ 783.289537] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.289770] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.289894] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.290163] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.290268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.290331] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.290482] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.290594] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.290742] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.290836] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.290888] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.291062] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.291127] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.291357] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.291427] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.291485] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.291643] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.291707] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.291784] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ce997a4-e173-41da-a149-86945dba84fe is going to be updated. [ 783.292880] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.293063] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.338050] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.338226] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.339049] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.339049] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.339347] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.339400] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.339501] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 is going to be updated. [ 783.344358] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.344781] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.344923] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.345249] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.345339] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.345442] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a41415ed-2788-44fc-9776-a1eea5a113ed already deleted. [ 783.345521] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a41415ed-2788-44fc-9776-a1eea5a113ed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.365609] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.365873] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.365960] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.366183] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.366382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.387202] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 in Status: IN_PROGRESS for 2s [ 783.400875] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997: rpc.has_security_group_logging(os_id): False [ 783.402121] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3db0e155-352c-4d42-a24e-48fff17d86ac: rpc.has_security_group_logging(os_id): False [ 783.424114] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.428293] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.428619] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.428970] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.429483] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.431984] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.432178] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.432247] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.432503] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.435607] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.435778] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.438623] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b11bc7eb-c1bb-49d4-8347-38576752a094: rpc.has_security_group_logging(os_id): False [ 783.440227] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for be6a78d7-b908-447c-a3f4-0f30c644939c: rpc.has_security_group_logging(os_id): False [ 783.442808] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c3590f1-016a-4b00-b83e-f52f030b948b: rpc.has_security_group_logging(os_id): False [ 783.446436] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.446637] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.448403] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.448585] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.448847] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a15c14c6-0aee-4e9d-b481-2661c510f44a: rpc.has_security_group_logging(os_id): False [ 783.461798] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ce997a4-e173-41da-a149-86945dba84fe in Status: IN_PROGRESS for 2s [ 783.500943] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.501260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.501652] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.501652] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.504033] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.504033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.511615] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.511615] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.522617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.523971] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.523971] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.523971] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.523971] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.523971] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.524258] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 is going to be updated. [ 783.525919] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.525919] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.580259] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.581044] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.581044] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.581044] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.581620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.581620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.581754] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3db0e155-352c-4d42-a24e-48fff17d86ac is going to be updated. [ 783.584081] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.584081] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.584399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.585983] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.587951] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.616757] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: IN_PROGRESS for 2s [ 783.626590] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.626828] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.627057] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.627057] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.627201] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.627451] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.627451] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c3590f1-016a-4b00-b83e-f52f030b948b is going to be updated. [ 783.628680] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.628884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.683641] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.683641] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.703024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.703024] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.703024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.703024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.703024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.703024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.703024] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b11bc7eb-c1bb-49d4-8347-38576752a094 is going to be updated. [ 783.703872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.704220] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.704610] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.705809] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.706155] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.729575] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.729794] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.763268] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 in Status: SUCCESS [ 783.764628] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.765399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.765817] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.765964] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.767458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.767458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.767458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.767458] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be6a78d7-b908-447c-a3f4-0f30c644939c is going to be updated. [ 783.769606] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.769606] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.769606] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.771581] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.772237] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.775240] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.775240] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.839817] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 in Status: IN_PROGRESS for 2s [ 783.848469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.849640] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.850227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.850227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.850347] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.850382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.850683] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.850869] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.850869] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.851161] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.851251] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.851553] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.851655] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.851702] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.852641] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.852641] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.852641] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be updated. [ 783.853511] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.854049] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.854049] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.855041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.855212] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.855344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.918713] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.918713] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.918713] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.918713] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.918713] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.942285] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c3590f1-016a-4b00-b83e-f52f030b948b in Status: IN_PROGRESS for 2s [ 783.945548] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3db0e155-352c-4d42-a24e-48fff17d86ac in Status: IN_PROGRESS for 2s [ 783.949156] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b11bc7eb-c1bb-49d4-8347-38576752a094 in Status: IN_PROGRESS for 2s [ 783.985376] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.986684] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.986684] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.986684] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.986684] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.027834] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be6a78d7-b908-447c-a3f4-0f30c644939c in Status: IN_PROGRESS for 2s [ 784.083470] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.083614] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.084578] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.084578] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.084578] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.162806] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: IN_PROGRESS for 2s [ 784.351327] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f46326b4-7843-4c05-8eca-cb73edd99c30 in Status: SUCCESS [ 784.351731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.380849] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06c1d39f-c76e-47c4-9900-046863c4e37a in Status: SUCCESS [ 784.381469] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06c1d39f-c76e-47c4-9900-046863c4e37a deletion is rescheduled due to dependency. [ 784.381469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.752474] env[66834]: INFO networking_nsxv3.common.synchronization [req-28561acd-d292-40ca-a3e1-62ee17b8c48c req-50649654-fdb3-4861-9a81-3c289add3d90 tempest-ServerDiskConfigTestJSON-362503924 tempest-ServerDiskConfigTestJSON-362503924-project-member] Enqueued Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 784.753559] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 784.754316] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.754316] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.754316] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.754316] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.754490] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.754490] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.754587] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.754731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.754835] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.754961] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.861945] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: SUCCESS [ 784.861945] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.257416] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.257590] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.257661] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.257886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.279190] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.279553] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.279691] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.279754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.279951] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.280105] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.280188] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7963c125-23b5-45fd-8158-f6470d12949e is going to be updated. [ 785.307165] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.307165] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.307165] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.308234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.308234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.316026] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: IN_PROGRESS for 2s [ 785.401848] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 in Status: SUCCESS [ 785.402137] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.477476] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ce997a4-e173-41da-a149-86945dba84fe in Status: SUCCESS [ 785.477843] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.631773] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: SUCCESS [ 785.632109] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.856242] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 in Status: SUCCESS [ 785.856242] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.959347] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c3590f1-016a-4b00-b83e-f52f030b948b in Status: SUCCESS [ 785.959587] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.960434] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3db0e155-352c-4d42-a24e-48fff17d86ac in Status: SUCCESS [ 785.960612] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.961271] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b11bc7eb-c1bb-49d4-8347-38576752a094 in Status: SUCCESS [ 785.961445] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.039729] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be6a78d7-b908-447c-a3f4-0f30c644939c in Status: SUCCESS [ 786.039729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.177276] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: SUCCESS [ 786.177276] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.326724] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: SUCCESS [ 787.327109] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7963c125-23b5-45fd-8158-f6470d12949e deletion is rescheduled due to dependency. [ 787.327109] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.915731] env[66834]: INFO networking_nsxv3.common.synchronization [req-2e59cec1-cf5a-4d81-b794-0077b37c34af req-3043b7bf-d914-47e6-9cfc-5238424a53a1 tempest-ListServerFiltersTestJSON-1401422689 tempest-ListServerFiltersTestJSON-1401422689-project-member] Enqueued Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGHEST for action security_group_members [ 787.916354] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGHEST for action security_group_members [ 787.917147] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.917413] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.918183] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.918400] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.918586] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.918694] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.918757] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.918903] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.918994] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.919483] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.348291] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-437 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.348291] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-437" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.348291] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-437" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.348724] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-437" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.349110] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.349299] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.349420] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.349688] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.349839] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.350065] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.350177] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 788.350279] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 788.350381] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 788.350685] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.350864] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 788.351103] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 788.373123] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 788.373290] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 788.373419] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 788.373613] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-437" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.373920] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-702b1fea-18d3-4d62-86bf-b813701a8edc taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.374091] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-702b1fea-18d3-4d62-86bf-b813701a8edc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.374197] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-702b1fea-18d3-4d62-86bf-b813701a8edc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.374503] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-702b1fea-18d3-4d62-86bf-b813701a8edc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.374633] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('702b1fea-18d3-4d62-86bf-b813701a8edc',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.422114] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.878849] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.878849] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.878849] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.880119] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.880119] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.880119] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 702b1fea-18d3-4d62-86bf-b813701a8edc not found, creating... [ 788.880119] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.880119] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.880119] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.880532] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.880532] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.880664] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.880823] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.880930] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.881157] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.881285] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.881421] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 702b1fea-18d3-4d62-86bf-b813701a8edc is going to be created. [ 788.904388] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.904644] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.904710] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.904967] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.905265] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.905509] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-702b1fea-18d3-4d62-86bf-b813701a8edc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.925031] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.429659] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.429659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.429659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.429659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.429659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.429659] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ce997a4-e173-41da-a149-86945dba84fe is going to be updated. [ 789.478655] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.478890] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.478938] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.479443] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.479666] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.516468] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ce997a4-e173-41da-a149-86945dba84fe in Status: IN_PROGRESS for 2s [ 789.643914] env[66834]: INFO networking_nsxv3.common.synchronization [req-2e59cec1-cf5a-4d81-b794-0077b37c34af req-6089f164-0e38-4ce3-8705-49f634570c3d service nova] Enqueued Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGHEST for action security_group_rules [ 789.644135] env[66834]: INFO networking_nsxv3.common.synchronization [req-2e59cec1-cf5a-4d81-b794-0077b37c34af req-6089f164-0e38-4ce3-8705-49f634570c3d service nova] Enqueued Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGHEST for action security_group_members [ 789.644240] env[66834]: INFO networking_nsxv3.common.synchronization [req-2e59cec1-cf5a-4d81-b794-0077b37c34af req-6089f164-0e38-4ce3-8705-49f634570c3d service nova] Enqueued Resource ID: 702b1fea-18d3-4d62-86bf-b813701a8edc with Priority: HIGHEST for action port [ 789.644523] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGHEST for action security_group_rules [ 789.644653] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGHEST for action security_group_members [ 789.644745] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 702b1fea-18d3-4d62-86bf-b813701a8edc with Priority: HIGHEST for action port [ 789.645708] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.645840] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.645909] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.646124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.646208] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.649933] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.650073] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.650357] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-702b1fea-18d3-4d62-86bf-b813701a8edc taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.650581] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-702b1fea-18d3-4d62-86bf-b813701a8edc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.650581] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-702b1fea-18d3-4d62-86bf-b813701a8edc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.650759] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-702b1fea-18d3-4d62-86bf-b813701a8edc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.650841] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('702b1fea-18d3-4d62-86bf-b813701a8edc',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.083612] env[66834]: INFO networking_nsxv3.common.synchronization [req-bbd3e696-1dc8-45cd-a6ab-b1cc5b81a257 req-d4258ea9-8711-4504-888c-1c0d9e2f6396 tempest-DeleteServersTestJSON-1250802255 tempest-DeleteServersTestJSON-1250802255-project-member] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 790.084163] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 790.084472] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.084591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.084655] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.084850] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.084996] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.085148] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.085206] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.085378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.085462] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.085554] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.158068] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.158068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.158068] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 702b1fea-18d3-4d62-86bf-b813701a8edc with status ACTIVE [ 790.158068] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.158068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.158068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.158068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.158068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.158068] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.158068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.158068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.158068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.158068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.158068] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.158694] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.158694] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.158694] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.158694] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.158694] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 702b1fea-18d3-4d62-86bf-b813701a8edc is going to be updated. [ 790.179188] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.179377] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.179440] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.179595] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.179733] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.179889] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-702b1fea-18d3-4d62-86bf-b813701a8edc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.536710] env[66834]: INFO networking_nsxv3.common.synchronization [req-faec0048-1f35-4793-861d-7e75f1d85474 req-6177b007-c71d-4906-8fd2-cef90812da6b tempest-ServersAdminTestJSON-835845617 tempest-ServersAdminTestJSON-835845617-project-member] Enqueued Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_members [ 790.537389] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_members [ 790.537687] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.537807] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.537872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.540221] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.540640] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.541103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.541231] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.541469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.541686] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.541825] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.588053] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.588053] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.588053] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.588306] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.588347] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.588557] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.588658] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.588718] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.588878] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.588956] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.589108] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be updated. [ 790.619438] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.619438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.619438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.619438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.619438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.628707] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: IN_PROGRESS for 2s [ 790.868764] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-958 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.870059] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-958" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.870059] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-958" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.870059] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-958" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.870759] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.870759] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.870922] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.871210] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.871395] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.871631] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 790.871789] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 790.871896] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 790.872038] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 790.872178] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 790.872311] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 790.872468] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 790.895901] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 790.896089] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 790.896221] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 790.896393] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-958" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.896721] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-a4d94080-0b19-4cbe-94e3-1fa587f2f5f5 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.896889] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-a4d94080-0b19-4cbe-94e3-1fa587f2f5f5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.897110] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-a4d94080-0b19-4cbe-94e3-1fa587f2f5f5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.897477] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-a4d94080-0b19-4cbe-94e3-1fa587f2f5f5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.897612] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4d94080-0b19-4cbe-94e3-1fa587f2f5f5',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.044050] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.399872] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.400673] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.400673] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.400801] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.400839] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.401020] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port a4d94080-0b19-4cbe-94e3-1fa587f2f5f5 not found, creating... [ 791.401278] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.401516] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.401637] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.401867] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.402009] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.402318] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.402471] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.402654] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.402993] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.403331] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.403425] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: a4d94080-0b19-4cbe-94e3-1fa587f2f5f5 is going to be created. [ 791.435227] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.435533] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.435604] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.435867] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.436219] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.436491] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-a4d94080-0b19-4cbe-94e3-1fa587f2f5f5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.528352] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ce997a4-e173-41da-a149-86945dba84fe in Status: SUCCESS [ 791.528598] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.528796] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.529090] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.529290] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.529570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.529570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.529697] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.529814] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.529946] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.545725] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.032253] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.048657] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.048820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.048889] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.049304] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.050225] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.050426] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9276c5a5-af43-4c6e-899f-c34039400160 is going to be updated. [ 792.088938] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.089173] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.089436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.089436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.089566] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.103995] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: IN_PROGRESS for 2s [ 792.235934] env[66834]: INFO networking_nsxv3.common.synchronization [req-faec0048-1f35-4793-861d-7e75f1d85474 req-e6e890c8-5e44-43af-a13f-de70e0adbf46 service nova] Enqueued Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_rules [ 792.236194] env[66834]: INFO networking_nsxv3.common.synchronization [req-faec0048-1f35-4793-861d-7e75f1d85474 req-e6e890c8-5e44-43af-a13f-de70e0adbf46 service nova] Enqueued Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_members [ 792.236275] env[66834]: INFO networking_nsxv3.common.synchronization [req-faec0048-1f35-4793-861d-7e75f1d85474 req-e6e890c8-5e44-43af-a13f-de70e0adbf46 service nova] Enqueued Resource ID: a4d94080-0b19-4cbe-94e3-1fa587f2f5f5 with Priority: HIGHEST for action port [ 792.237411] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_rules [ 792.237625] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_members [ 792.237766] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4d94080-0b19-4cbe-94e3-1fa587f2f5f5 with Priority: HIGHEST for action port [ 792.238117] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.238268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.238371] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.238621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.238743] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.239812] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.239965] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.240534] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4d94080-0b19-4cbe-94e3-1fa587f2f5f5 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.240534] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4d94080-0b19-4cbe-94e3-1fa587f2f5f5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.240534] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4d94080-0b19-4cbe-94e3-1fa587f2f5f5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.241430] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4d94080-0b19-4cbe-94e3-1fa587f2f5f5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.241545] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4d94080-0b19-4cbe-94e3-1fa587f2f5f5',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.536874] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.640407] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: SUCCESS [ 792.640797] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a deletion is rescheduled due to dependency. [ 792.640797] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.743368] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.743599] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.743831] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a4d94080-0b19-4cbe-94e3-1fa587f2f5f5 with status ACTIVE [ 792.744085] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.744243] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.744350] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.744659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.744790] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.744981] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.745114] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.745180] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.745419] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.745487] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.745697] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.745843] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.745942] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.746179] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.746301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.746410] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a4d94080-0b19-4cbe-94e3-1fa587f2f5f5 is going to be updated. [ 792.771401] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.771629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.771629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.771837] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.771973] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.772146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4d94080-0b19-4cbe-94e3-1fa587f2f5f5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.041518] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.041698] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.041746] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.042142] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.042142] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.042142] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ce997a4-e173-41da-a149-86945dba84fe is going to be updated. [ 793.072800] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.072906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.072906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.073234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.073404] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.084034] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ce997a4-e173-41da-a149-86945dba84fe in Status: IN_PROGRESS for 2s [ 793.454165] env[66834]: INFO networking_nsxv3.common.synchronization [req-e1663387-24dd-4617-8f1d-e47314c6d1da req-5f71e631-0273-4346-981e-873780bd8eb4 tempest-ListImageFiltersTestJSON-1653843489 tempest-ListImageFiltersTestJSON-1653843489-project-member] Enqueued Resource ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd with Priority: HIGHEST for action security_group_members [ 793.454775] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd with Priority: HIGHEST for action security_group_members [ 793.454952] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.455103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.455186] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.455426] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.455626] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.455754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.455868] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.456055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.456144] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.456241] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e7c2a7-894d-4c35-9c95-4f7fee507dfd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.778134] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-582 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.778494] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.778536] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.778777] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.779046] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.779270] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.779387] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.779611] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.779752] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.779955] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.780115] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 793.780239] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 793.780345] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 793.780477] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.780585] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 793.780716] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 793.802053] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 793.802225] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 793.802363] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 793.802580] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.802946] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-e99437db-400e-4912-a64e-f23be6b76b7a taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.803139] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-e99437db-400e-4912-a64e-f23be6b76b7a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.803263] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-e99437db-400e-4912-a64e-f23be6b76b7a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.803707] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-e99437db-400e-4912-a64e-f23be6b76b7a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.803707] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e99437db-400e-4912-a64e-f23be6b76b7a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.959034] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.959322] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.959407] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.959594] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.959718] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.959912] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.960042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.960124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.960323] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.960412] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.960503] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd already deleted. [ 793.960596] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.116473] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: SUCCESS [ 794.116877] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.117252] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.117628] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.117878] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.118175] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.118268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.118469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.118577] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.118788] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.310637] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.310637] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.310637] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.311010] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.311237] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.311482] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port e99437db-400e-4912-a64e-f23be6b76b7a not found, creating... [ 794.311888] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.312128] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.312258] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.312498] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.312658] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.312952] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.313123] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.313241] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.313456] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.313587] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.313724] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: e99437db-400e-4912-a64e-f23be6b76b7a is going to be created. [ 794.342540] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.342757] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.342914] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.343122] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.343891] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.343986] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-e99437db-400e-4912-a64e-f23be6b76b7a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.621108] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.096661] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ce997a4-e173-41da-a149-86945dba84fe in Status: SUCCESS [ 795.096661] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.096661] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.097387] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.097387] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.097387] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.097387] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.097660] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.097786] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.097924] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.098083] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.112156] env[66834]: INFO networking_nsxv3.common.synchronization [req-e1663387-24dd-4617-8f1d-e47314c6d1da req-0c4cc79f-e388-4618-9ea6-cf9837551a39 service nova] Enqueued Resource ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd with Priority: HIGHEST for action security_group_rules [ 795.112349] env[66834]: INFO networking_nsxv3.common.synchronization [req-e1663387-24dd-4617-8f1d-e47314c6d1da req-0c4cc79f-e388-4618-9ea6-cf9837551a39 service nova] Enqueued Resource ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd with Priority: HIGHEST for action security_group_members [ 795.112491] env[66834]: INFO networking_nsxv3.common.synchronization [req-e1663387-24dd-4617-8f1d-e47314c6d1da req-0c4cc79f-e388-4618-9ea6-cf9837551a39 service nova] Enqueued Resource ID: e99437db-400e-4912-a64e-f23be6b76b7a with Priority: HIGHEST for action port [ 795.113115] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd with Priority: HIGHEST for action security_group_rules [ 795.113232] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd with Priority: HIGHEST for action security_group_members [ 795.113407] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e99437db-400e-4912-a64e-f23be6b76b7a with Priority: HIGHEST for action port [ 795.113705] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68e7c2a7-894d-4c35-9c95-4f7fee507dfd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.113830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.113895] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.114695] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.114774] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68e7c2a7-894d-4c35-9c95-4f7fee507dfd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.118448] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.118448] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.118597] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.118830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.119057] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.119562] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.119562] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.119562] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.119724] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.119758] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e7c2a7-894d-4c35-9c95-4f7fee507dfd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.121185] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-e99437db-400e-4912-a64e-f23be6b76b7a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.121185] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e99437db-400e-4912-a64e-f23be6b76b7a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.121185] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e99437db-400e-4912-a64e-f23be6b76b7a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.121660] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e99437db-400e-4912-a64e-f23be6b76b7a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.121660] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e99437db-400e-4912-a64e-f23be6b76b7a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.124603] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.601158] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.601456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.601456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.601769] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.601944] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.602068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.602124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.602285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.602373] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.602461] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.602614] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.602708] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.602775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.602913] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.603067] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.603160] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.603219] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.603357] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.603445] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.603505] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.603602] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.623888] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68e7c2a7-894d-4c35-9c95-4f7fee507dfd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.625924] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.625924] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.626647] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e99437db-400e-4912-a64e-f23be6b76b7a with status ACTIVE [ 795.627010] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.627159] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.627966] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.627966] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.627966] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.627966] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.628275] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.628275] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.629237] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.629237] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.629237] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.629237] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.629237] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.629489] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.629489] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.629548] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e99437db-400e-4912-a64e-f23be6b76b7a is going to be updated. [ 795.631377] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.631548] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.631607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.631864] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.631962] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.632146] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9276c5a5-af43-4c6e-899f-c34039400160 is going to be updated. [ 795.664050] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.664212] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.664293] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.664647] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.664795] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.664971] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e99437db-400e-4912-a64e-f23be6b76b7a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.671803] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.671972] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.672065] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.672450] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.672541] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.690680] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: IN_PROGRESS for 2s [ 796.108023] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ce997a4-e173-41da-a149-86945dba84fe: rpc.has_security_group_logging(os_id): False [ 796.126653] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.126861] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.127017] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.127406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.127630] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.127927] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.128133] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.128483] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.128742] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.128873] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.129229] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.129403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.129514] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.130717] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.131080] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.131342] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.131472] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.131543] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.131699] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.131778] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.131878] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ce997a4-e173-41da-a149-86945dba84fe is going to be updated. [ 796.133241] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68e7c2a7-894d-4c35-9c95-4f7fee507dfd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.198507] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.198683] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.198731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.198963] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.199175] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.225762] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ce997a4-e173-41da-a149-86945dba84fe in Status: IN_PROGRESS for 2s [ 796.635920] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.636136] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.636185] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.636563] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.636702] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.636816] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd is going to be created. [ 796.667668] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.667812] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.667894] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.668209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.668769] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.679696] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd in Status: UNINITIALIZED for 2s [ 797.700053] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: SUCCESS [ 797.700407] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.700407] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.700592] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.700794] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.700903] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.700974] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.701123] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.701203] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.701287] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.701449] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.204749] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.205362] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.205362] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.205362] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.205362] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.205573] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.205573] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.205687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.205761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.205857] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.206015] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.206131] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.206175] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.206540] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.206540] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.206540] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.206714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.206714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.206832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.206866] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.206926] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.246678] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ce997a4-e173-41da-a149-86945dba84fe in Status: SUCCESS [ 798.246886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.691533] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd in Status: SUCCESS [ 798.691816] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.692074] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.692375] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.692642] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.692804] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.692900] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.693130] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.693249] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.693374] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.693508] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68e7c2a7-894d-4c35-9c95-4f7fee507dfd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.708836] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9276c5a5-af43-4c6e-899f-c34039400160: rpc.has_security_group_logging(os_id): False [ 798.741216] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.741216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.741216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.741216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.741216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.742064] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.742064] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.742064] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.742064] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.742064] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.742064] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.742064] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.742829] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.742829] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.742829] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.742829] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.742829] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.742829] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.743022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.743022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.743190] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9276c5a5-af43-4c6e-899f-c34039400160 is going to be updated. [ 798.826309] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.826309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.826309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.826566] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.826566] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.851359] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: IN_PROGRESS for 2s [ 799.197033] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.197033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.197033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.197033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.197033] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.197396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.197396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.197396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.197396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.197523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.197606] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.197696] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.197750] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.197885] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.198665] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.198665] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.198665] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.198665] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.198665] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.198665] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.198665] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68e7c2a7-894d-4c35-9c95-4f7fee507dfd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.306025] env[66834]: INFO networking_nsxv3.common.synchronization [req-3bf74d9f-ef36-4eed-9313-9e20b959096c req-be36fd19-be6f-4e97-bc6f-8b7f1019f9d0 tempest-ServerMetadataTestJSON-1053450456 tempest-ServerMetadataTestJSON-1053450456-project-member] Enqueued Resource ID: 87920817-9bc0-40b2-945a-8057b5158162 with Priority: HIGHEST for action security_group_members [ 799.307513] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87920817-9bc0-40b2-945a-8057b5158162 with Priority: HIGHEST for action security_group_members [ 799.308395] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-87920817-9bc0-40b2-945a-8057b5158162 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.308537] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.308619] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.308861] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.309408] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.309589] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.309658] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.309854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.309946] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.310078] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87920817-9bc0-40b2-945a-8057b5158162',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.682380] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-985 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.683069] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-985" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.683069] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-985" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.683069] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-985" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.683249] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.683385] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.683500] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.683703] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.683839] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.684093] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 799.684155] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 799.684260] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 799.684434] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 799.684538] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 799.684642] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 799.684772] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 799.701490] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68e7c2a7-894d-4c35-9c95-4f7fee507dfd: rpc.has_security_group_logging(os_id): False [ 799.711166] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 799.711511] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 799.711511] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 799.711674] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-985" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.712023] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-7a1f4a7c-dc9f-4bc2-922b-1609e7615791 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.712226] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-7a1f4a7c-dc9f-4bc2-922b-1609e7615791" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.712341] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-7a1f4a7c-dc9f-4bc2-922b-1609e7615791" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.712681] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-7a1f4a7c-dc9f-4bc2-922b-1609e7615791" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.712818] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a1f4a7c-dc9f-4bc2-922b-1609e7615791',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.726554] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.726728] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.726768] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.728022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.728022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.728022] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.728022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.728022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.728022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.728022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.728380] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.728380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.728380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.728380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.728526] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.728565] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.728648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.728705] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.728842] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.728909] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.728989] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd is going to be created. [ 799.797479] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.799835] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.799835] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.799835] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.799835] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.815698] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.815698] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.815698] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.815698] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.815698] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.815698] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.815698] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.815698] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.815698] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.815698] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.815698] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87920817-9bc0-40b2-945a-8057b5158162 already deleted. [ 799.815698] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.816346] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd in Status: IN_PROGRESS for 2s [ 800.215751] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.215967] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.216108] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.216398] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.216539] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.216685] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 7a1f4a7c-dc9f-4bc2-922b-1609e7615791 not found, creating... [ 800.216939] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.217232] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.217393] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.217608] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.217738] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.218026] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.218179] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.218289] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.218487] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.218612] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.218743] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 7a1f4a7c-dc9f-4bc2-922b-1609e7615791 is going to be created. [ 800.240921] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.241145] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.241252] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.241532] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.241760] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.241986] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-7a1f4a7c-dc9f-4bc2-922b-1609e7615791" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.869844] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: SUCCESS [ 800.870137] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.995375] env[66834]: INFO networking_nsxv3.common.synchronization [req-3bf74d9f-ef36-4eed-9313-9e20b959096c req-fc973cea-b2a8-43b8-a0a6-76da540ea460 service nova] Enqueued Resource ID: 87920817-9bc0-40b2-945a-8057b5158162 with Priority: HIGHEST for action security_group_rules [ 800.995568] env[66834]: INFO networking_nsxv3.common.synchronization [req-3bf74d9f-ef36-4eed-9313-9e20b959096c req-fc973cea-b2a8-43b8-a0a6-76da540ea460 service nova] Enqueued Resource ID: 87920817-9bc0-40b2-945a-8057b5158162 with Priority: HIGHEST for action security_group_members [ 800.995716] env[66834]: INFO networking_nsxv3.common.synchronization [req-3bf74d9f-ef36-4eed-9313-9e20b959096c req-fc973cea-b2a8-43b8-a0a6-76da540ea460 service nova] Enqueued Resource ID: 7a1f4a7c-dc9f-4bc2-922b-1609e7615791 with Priority: HIGHEST for action port [ 800.996258] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87920817-9bc0-40b2-945a-8057b5158162 with Priority: HIGHEST for action security_group_rules [ 800.996409] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87920817-9bc0-40b2-945a-8057b5158162 with Priority: HIGHEST for action security_group_members [ 800.996513] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a1f4a7c-dc9f-4bc2-922b-1609e7615791 with Priority: HIGHEST for action port [ 800.996799] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87920817-9bc0-40b2-945a-8057b5158162 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.996930] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.996999] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.997315] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.997444] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87920817-9bc0-40b2-945a-8057b5158162',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.998284] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-87920817-9bc0-40b2-945a-8057b5158162 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.998401] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.998470] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.998653] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.998801] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.998906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.998969] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.999149] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.999236] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.999326] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87920817-9bc0-40b2-945a-8057b5158162',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.001439] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a1f4a7c-dc9f-4bc2-922b-1609e7615791 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.001556] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a1f4a7c-dc9f-4bc2-922b-1609e7615791" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.001610] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a1f4a7c-dc9f-4bc2-922b-1609e7615791" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.001771] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a1f4a7c-dc9f-4bc2-922b-1609e7615791" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.001846] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a1f4a7c-dc9f-4bc2-922b-1609e7615791',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.505093] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87920817-9bc0-40b2-945a-8057b5158162',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.505093] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-87920817-9bc0-40b2-945a-8057b5158162 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.505093] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.505093] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a1f4a7c-dc9f-4bc2-922b-1609e7615791 with status ACTIVE [ 801.505275] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.505334] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.505381] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.505599] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.505686] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.505860] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.505956] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.506025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.506488] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.506569] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.506717] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.506811] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.506870] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.507023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.507176] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.507301] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a1f4a7c-dc9f-4bc2-922b-1609e7615791 is going to be updated. [ 801.529681] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.529848] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.529904] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.530108] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.530244] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.530394] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a1f4a7c-dc9f-4bc2-922b-1609e7615791" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.830964] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd in Status: SUCCESS [ 801.830964] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.009589] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87920817-9bc0-40b2-945a-8057b5158162',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.089135] env[66834]: INFO networking_nsxv3.common.synchronization [req-80ead08b-4ad8-4b28-818d-b1310f311122 req-2c33e9ae-5ffa-4c9c-8f5b-d3d242a29934 tempest-ListImageFiltersTestJSON-1653843489 tempest-ListImageFiltersTestJSON-1653843489-project-member] Enqueued Resource ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd with Priority: HIGHEST for action security_group_members [ 802.089915] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd with Priority: HIGHEST for action security_group_members [ 802.090240] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.090374] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.090442] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.090641] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.090793] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.090890] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.090951] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.091621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.091757] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.091880] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e7c2a7-894d-4c35-9c95-4f7fee507dfd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.416265] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-582 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.416489] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.416663] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.416989] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.417282] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.417475] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.417608] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.417862] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.418029] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.418284] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.418425] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 802.418565] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 802.418690] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 802.418804] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.418908] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 802.419049] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 802.449394] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 802.449646] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 802.449712] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 802.450116] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-582" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.450524] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-1cd82ec3-1f5e-4f98-a2dc-42cbdb176222 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.450798] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-1cd82ec3-1f5e-4f98-a2dc-42cbdb176222" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.450798] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-1cd82ec3-1f5e-4f98-a2dc-42cbdb176222" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.451207] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-1cd82ec3-1f5e-4f98-a2dc-42cbdb176222" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.451346] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cd82ec3-1f5e-4f98-a2dc-42cbdb176222',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.512342] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.512479] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.512582] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.512749] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.513114] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.513114] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87920817-9bc0-40b2-945a-8057b5158162 is going to be created. [ 802.536652] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.536802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.536874] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.537269] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.537475] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.549773] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87920817-9bc0-40b2-945a-8057b5158162 in Status: UNINITIALIZED for 2s [ 802.597644] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68e7c2a7-894d-4c35-9c95-4f7fee507dfd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.953491] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.953771] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.954729] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.955861] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.955861] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.955861] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 1cd82ec3-1f5e-4f98-a2dc-42cbdb176222 not found, creating... [ 802.955861] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.956120] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.956120] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.956336] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.956475] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.956901] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.957133] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.957258] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.957484] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.957615] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.957753] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 1cd82ec3-1f5e-4f98-a2dc-42cbdb176222 is going to be created. [ 802.982086] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.982086] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.982086] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.982347] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.982634] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.982906] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-1cd82ec3-1f5e-4f98-a2dc-42cbdb176222" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.100517] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68e7c2a7-894d-4c35-9c95-4f7fee507dfd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.604175] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.604397] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.604632] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.604948] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.605082] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.605194] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd is going to be updated. [ 803.639598] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.639875] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.639875] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.640042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.640216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.650592] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd in Status: IN_PROGRESS for 2s [ 803.739853] env[66834]: INFO networking_nsxv3.common.synchronization [req-80ead08b-4ad8-4b28-818d-b1310f311122 req-1f175f6e-6d85-4874-8348-bbfd416abc48 service nova] Enqueued Resource ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd with Priority: HIGHEST for action security_group_rules [ 803.740095] env[66834]: INFO networking_nsxv3.common.synchronization [req-80ead08b-4ad8-4b28-818d-b1310f311122 req-1f175f6e-6d85-4874-8348-bbfd416abc48 service nova] Enqueued Resource ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd with Priority: HIGHEST for action security_group_members [ 803.740314] env[66834]: INFO networking_nsxv3.common.synchronization [req-80ead08b-4ad8-4b28-818d-b1310f311122 req-1f175f6e-6d85-4874-8348-bbfd416abc48 service nova] Enqueued Resource ID: 1cd82ec3-1f5e-4f98-a2dc-42cbdb176222 with Priority: HIGHEST for action port [ 803.741117] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd with Priority: HIGHEST for action security_group_rules [ 803.741232] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd with Priority: HIGHEST for action security_group_members [ 803.741322] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd82ec3-1f5e-4f98-a2dc-42cbdb176222 with Priority: HIGHEST for action port [ 803.741617] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68e7c2a7-894d-4c35-9c95-4f7fee507dfd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.741768] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.741801] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.742301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.742301] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68e7c2a7-894d-4c35-9c95-4f7fee507dfd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.743839] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.743938] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.744165] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-1cd82ec3-1f5e-4f98-a2dc-42cbdb176222 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.744319] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1cd82ec3-1f5e-4f98-a2dc-42cbdb176222" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.744376] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1cd82ec3-1f5e-4f98-a2dc-42cbdb176222" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.744564] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1cd82ec3-1f5e-4f98-a2dc-42cbdb176222" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.744645] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cd82ec3-1f5e-4f98-a2dc-42cbdb176222',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.245366] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.245705] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.249897] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1cd82ec3-1f5e-4f98-a2dc-42cbdb176222 with status ACTIVE [ 804.250298] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.250575] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.250854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.251096] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.251248] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.251532] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.251758] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.251816] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.252050] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.252401] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.252605] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.252755] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.252853] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.253273] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.253453] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.253630] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1cd82ec3-1f5e-4f98-a2dc-42cbdb176222 is going to be updated. [ 804.278303] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.278503] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.278503] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.278743] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.278895] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.279075] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1cd82ec3-1f5e-4f98-a2dc-42cbdb176222" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.559428] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87920817-9bc0-40b2-945a-8057b5158162 in Status: SUCCESS [ 804.559638] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.559805] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.560028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.560241] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.560370] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.560447] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.560586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.560662] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.560741] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.560828] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('87920817-9bc0-40b2-945a-8057b5158162',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.066356] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-87920817-9bc0-40b2-945a-8057b5158162 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.066585] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.066662] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.066899] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.067105] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.067262] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.067331] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.067498] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.067584] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.067676] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.067830] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-87920817-9bc0-40b2-945a-8057b5158162 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.067924] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.067995] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.068146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.068283] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.068386] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.068447] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.068583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.068656] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.068737] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.068823] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('87920817-9bc0-40b2-945a-8057b5158162',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.570944] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 87920817-9bc0-40b2-945a-8057b5158162: rpc.has_security_group_logging(os_id): False [ 805.593843] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.594155] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.594312] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.594719] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.594841] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.595142] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.595339] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.595466] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.595688] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.595883] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.596177] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.596368] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.596510] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.596850] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.597013] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.597584] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.597584] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.597584] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.597801] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.597801] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.597911] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87920817-9bc0-40b2-945a-8057b5158162 is going to be created. [ 805.666290] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd in Status: SUCCESS [ 805.666290] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.666290] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.666290] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.666290] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.666290] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.666290] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.666290] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.666290] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.666290] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e7c2a7-894d-4c35-9c95-4f7fee507dfd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.670389] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.672011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.672011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.672011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.672011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.684771] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87920817-9bc0-40b2-945a-8057b5158162 in Status: IN_PROGRESS for 2s [ 806.175981] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68e7c2a7-894d-4c35-9c95-4f7fee507dfd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.678468] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68e7c2a7-894d-4c35-9c95-4f7fee507dfd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.028939] env[66834]: INFO networking_nsxv3.common.synchronization [req-1313bbdb-b7b7-4d8d-9f74-fd8f06592f46 req-99ed86e1-0d1a-474b-8554-beb4caab3422 tempest-ImagesTestJSON-910661197 tempest-ImagesTestJSON-910661197-project-member] Enqueued Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 807.029662] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 807.030318] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.030614] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.030697] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.030928] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.031114] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.031250] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.031357] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.031664] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.031664] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.031664] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.180067] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.180439] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.180439] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.181719] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.181719] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.181719] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd is going to be updated. [ 807.218286] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.218507] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.218579] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.218813] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.218967] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.230330] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd in Status: IN_PROGRESS for 2s [ 807.455131] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-793 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.455435] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-793" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.455611] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-793" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.455902] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-793" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.456203] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.456399] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.456618] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.456843] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.457038] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.457225] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 807.457337] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 807.457442] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 807.457543] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 807.457651] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 807.457746] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 807.457874] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 807.477443] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 807.477679] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 807.477808] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 807.477981] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-793" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.478317] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-cf1cae37-efd5-4fd5-b1e8-b1506f6813f3 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.478488] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-cf1cae37-efd5-4fd5-b1e8-b1506f6813f3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.478604] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-cf1cae37-efd5-4fd5-b1e8-b1506f6813f3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.478927] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-cf1cae37-efd5-4fd5-b1e8-b1506f6813f3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.479076] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf1cae37-efd5-4fd5-b1e8-b1506f6813f3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.534217] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.534467] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.534584] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.534865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.534921] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.535119] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.535239] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.535277] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.535518] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.535518] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.535626] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 is going to be deleted. [ 807.564159] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.564343] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.564419] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.564602] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.564693] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.564791] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.697592] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87920817-9bc0-40b2-945a-8057b5158162 in Status: SUCCESS [ 807.697934] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.982671] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.983038] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.983195] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.983754] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.983754] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.983959] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port cf1cae37-efd5-4fd5-b1e8-b1506f6813f3 not found, creating... [ 807.984286] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.984485] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.984634] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.984875] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.985050] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.985386] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.985545] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.985700] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.985886] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.986028] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.986206] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: cf1cae37-efd5-4fd5-b1e8-b1506f6813f3 is going to be created. [ 808.013310] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.013663] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.013893] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.014584] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.014943] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.015465] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-cf1cae37-efd5-4fd5-b1e8-b1506f6813f3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.709132] env[66834]: INFO networking_nsxv3.common.synchronization [req-1313bbdb-b7b7-4d8d-9f74-fd8f06592f46 req-6e76cfdf-c9cd-47e5-b5db-f41d2c387962 service nova] Enqueued Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_rules [ 808.709465] env[66834]: INFO networking_nsxv3.common.synchronization [req-1313bbdb-b7b7-4d8d-9f74-fd8f06592f46 req-6e76cfdf-c9cd-47e5-b5db-f41d2c387962 service nova] Enqueued Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 808.709465] env[66834]: INFO networking_nsxv3.common.synchronization [req-1313bbdb-b7b7-4d8d-9f74-fd8f06592f46 req-6e76cfdf-c9cd-47e5-b5db-f41d2c387962 service nova] Enqueued Resource ID: cf1cae37-efd5-4fd5-b1e8-b1506f6813f3 with Priority: HIGHEST for action port [ 808.709981] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_rules [ 808.710508] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 808.710627] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf1cae37-efd5-4fd5-b1e8-b1506f6813f3 with Priority: HIGHEST for action port [ 808.710910] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.711173] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.711173] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.711602] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.711602] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.713376] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.713500] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.713617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.713754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.714074] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.714205] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.714322] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.714475] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.714564] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.714659] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.716067] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf1cae37-efd5-4fd5-b1e8-b1506f6813f3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.716067] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf1cae37-efd5-4fd5-b1e8-b1506f6813f3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.716067] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf1cae37-efd5-4fd5-b1e8-b1506f6813f3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.716067] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf1cae37-efd5-4fd5-b1e8-b1506f6813f3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.716067] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf1cae37-efd5-4fd5-b1e8-b1506f6813f3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.222382] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf1cae37-efd5-4fd5-b1e8-b1506f6813f3 with status ACTIVE [ 809.222428] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.222714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.222714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.222802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.222885] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.223132] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.223329] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.223329] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.225188] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.225188] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.225188] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.225188] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.225188] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.225721] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.225792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.225854] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf1cae37-efd5-4fd5-b1e8-b1506f6813f3 is going to be updated. [ 809.227125] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.227242] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.227666] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.248287] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd in Status: SUCCESS [ 809.248287] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.248287] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.248287] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.248287] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.248287] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.248287] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.248287] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.248287] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.248715] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.248715] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68e7c2a7-894d-4c35-9c95-4f7fee507dfd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.259127] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.259290] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.259367] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.259698] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.259774] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.259865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf1cae37-efd5-4fd5-b1e8-b1506f6813f3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.646734] env[66834]: INFO networking_nsxv3.common.synchronization [None req-a5ee4cc2-e217-462a-9872-18ce3133d555 None None] Enqueued Resource ID: 1777c677-5328-48ce-8a9b-7654aea46fed with Priority: HIGHEST for action port [ 809.647847] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1777c677-5328-48ce-8a9b-7654aea46fed with Priority: HIGHEST for action port [ 809.647847] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-1777c677-5328-48ce-8a9b-7654aea46fed taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.647847] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1777c677-5328-48ce-8a9b-7654aea46fed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.647847] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1777c677-5328-48ce-8a9b-7654aea46fed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.649577] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1777c677-5328-48ce-8a9b-7654aea46fed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.649752] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1777c677-5328-48ce-8a9b-7654aea46fed',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.734046] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.751150] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.752510] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.753830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.753830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.753830] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.753830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.753830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.755349] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.755750] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.755918] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.759324] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.759459] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.759544] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.759845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.760699] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.760866] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.760939] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.761160] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.761255] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.761343] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.761435] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68e7c2a7-894d-4c35-9c95-4f7fee507dfd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.155401] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1777c677-5328-48ce-8a9b-7654aea46fed [ 810.156753] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.156753] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.156753] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.156753] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.156753] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.156753] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1777c677-5328-48ce-8a9b-7654aea46fed already deleted. [ 810.156753] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1777c677-5328-48ce-8a9b-7654aea46fed" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.237383] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.237555] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.237602] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.237820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.237908] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.238056] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 is going to be created. [ 810.264888] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.265085] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.265176] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.265379] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.265547] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.266743] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68e7c2a7-894d-4c35-9c95-4f7fee507dfd: rpc.has_security_group_logging(os_id): False [ 810.278016] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: UNINITIALIZED for 2s [ 810.284443] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.284666] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.284666] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.284855] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.284984] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.285182] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.285285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.285357] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.285630] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.285769] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.285969] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.286086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.286147] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.286324] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.286378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.286546] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.286635] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.286691] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.286831] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.286901] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.286984] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd is going to be updated. [ 810.381406] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.381406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.381406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.381406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.381869] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.395501] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd in Status: IN_PROGRESS for 2s [ 811.605773] env[66834]: INFO networking_nsxv3.common.synchronization [req-343dcad2-c240-4d70-811b-558e2179f740 req-263b925c-f196-43ac-ade1-061f566f2395 tempest-ServersTestFqdnHostnames-454654824 tempest-ServersTestFqdnHostnames-454654824-project-member] Enqueued Resource ID: 3db0e155-352c-4d42-a24e-48fff17d86ac with Priority: HIGHEST for action security_group_members [ 811.606467] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3db0e155-352c-4d42-a24e-48fff17d86ac with Priority: HIGHEST for action security_group_members [ 811.606825] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3db0e155-352c-4d42-a24e-48fff17d86ac taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.606966] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.607309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.607641] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.607851] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.608193] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.608335] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.608568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.608711] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.608843] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3db0e155-352c-4d42-a24e-48fff17d86ac',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.112012] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.112375] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.112532] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.112798] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.112940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.113212] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.113430] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.113499] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.113705] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.113828] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.113957] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3db0e155-352c-4d42-a24e-48fff17d86ac is going to be updated. [ 812.156088] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.156088] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.156088] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.156088] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.156754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.169622] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3db0e155-352c-4d42-a24e-48fff17d86ac in Status: IN_PROGRESS for 2s [ 812.289266] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: SUCCESS [ 812.291268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.291516] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.291888] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.291984] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.292109] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.292168] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.292936] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.292936] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.292936] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.292936] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.410957] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd in Status: SUCCESS [ 812.410957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.434232] env[66834]: INFO networking_nsxv3.common.synchronization [None req-4ae3a873-89ca-4090-ab25-c99b3cac7603 None None] Enqueued Resource ID: 7f1027ab-6dd0-4452-b381-3f547e188057 with Priority: HIGHEST for action port [ 812.434232] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f1027ab-6dd0-4452-b381-3f547e188057 with Priority: HIGHEST for action port [ 812.434232] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f1027ab-6dd0-4452-b381-3f547e188057 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.434232] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f1027ab-6dd0-4452-b381-3f547e188057" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.434629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f1027ab-6dd0-4452-b381-3f547e188057" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.434978] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f1027ab-6dd0-4452-b381-3f547e188057" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.435445] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f1027ab-6dd0-4452-b381-3f547e188057',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.796202] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.796539] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.796539] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.796652] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.796791] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.796971] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.796971] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.797128] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.797203] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.797274] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.797439] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.797549] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.797615] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.800023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.800023] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.800023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.800023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.800023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.800023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.800023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.800023] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.938793] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f1027ab-6dd0-4452-b381-3f547e188057 [ 812.938793] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.938793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.938793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.938793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.938793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.938793] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f1027ab-6dd0-4452-b381-3f547e188057 already deleted. [ 812.939381] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f1027ab-6dd0-4452-b381-3f547e188057" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.302461] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 599d582a-c0d7-4df7-a1fe-3e63412d8939: rpc.has_security_group_logging(os_id): False [ 813.323870] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.324100] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.324197] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.324404] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.324624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.325054] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.325054] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.325054] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.325296] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.325296] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.325574] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.325654] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.325739] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.326184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.326288] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.326509] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.326665] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.326762] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.327423] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.327423] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.327423] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 is going to be created. [ 813.423708] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.423972] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.424086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.424308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.424483] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.441869] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: IN_PROGRESS for 2s [ 814.180491] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3db0e155-352c-4d42-a24e-48fff17d86ac in Status: SUCCESS [ 814.180789] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3db0e155-352c-4d42-a24e-48fff17d86ac deletion is rescheduled due to dependency. [ 814.180844] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.799639] env[66834]: INFO networking_nsxv3.common.synchronization [req-e2fbef81-8cff-4857-897c-0fc64dc209aa req-56bc45ee-c81d-4874-8066-266ebf4d1176 tempest-ServerActionsTestJSON-2105447671 tempest-ServerActionsTestJSON-2105447671-project-member] Enqueued Resource ID: b372a601-425a-4557-bfbf-2682fc337d0d with Priority: HIGHEST for action security_group_members [ 814.801619] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b372a601-425a-4557-bfbf-2682fc337d0d with Priority: HIGHEST for action security_group_members [ 814.801619] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-b372a601-425a-4557-bfbf-2682fc337d0d taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.801619] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.801619] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.801619] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.801619] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.801619] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.801619] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.801619] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.801619] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.802187] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b372a601-425a-4557-bfbf-2682fc337d0d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.228358] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-591 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.228628] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-591" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.228740] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-591" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.230367] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-591" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.230367] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.230367] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.230367] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.230367] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.230983] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.230983] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 815.230983] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 815.230983] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 815.230983] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 815.231183] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 815.231183] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 815.231411] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 815.251691] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 815.251822] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 815.251955] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 815.252166] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-591" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.252475] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-e70617a6-b23b-4608-ad48-40b40b34a411 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.252645] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-e70617a6-b23b-4608-ad48-40b40b34a411" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.252758] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-e70617a6-b23b-4608-ad48-40b40b34a411" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.253105] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-e70617a6-b23b-4608-ad48-40b40b34a411" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.253249] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e70617a6-b23b-4608-ad48-40b40b34a411',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.306078] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.306272] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.306436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.306671] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.306779] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.307434] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.307570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.307570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.307746] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.307790] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.307888] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b372a601-425a-4557-bfbf-2682fc337d0d already deleted. [ 815.307989] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.461226] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: SUCCESS [ 815.461538] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.756054] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.756300] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.756390] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.756750] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.756905] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.757072] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port e70617a6-b23b-4608-ad48-40b40b34a411 not found, creating... [ 815.757344] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.757490] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.757594] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.757835] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.757961] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.758247] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.758395] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.758508] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.758702] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.758827] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.759688] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: e70617a6-b23b-4608-ad48-40b40b34a411 is going to be created. [ 815.788027] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.788027] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.788027] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.788027] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.788027] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.788027] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-e70617a6-b23b-4608-ad48-40b40b34a411" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.804473] env[66834]: INFO networking_nsxv3.common.synchronization [req-1e19fccb-a96b-40b0-929e-a12afc726476 req-6b2ffc49-c6d7-4728-a6f9-b57ac6c72e1d tempest-VolumesAssistedSnapshotsTest-105506614 tempest-VolumesAssistedSnapshotsTest-105506614-project-member] Enqueued Resource ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 with Priority: HIGHEST for action security_group_members [ 815.804646] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 with Priority: HIGHEST for action security_group_members [ 815.805488] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-386f2bfa-81a7-40ba-a9a8-a207890c2528 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.805488] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.805488] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.805488] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.805755] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.805755] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.805755] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.805882] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.806415] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.806415] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('386f2bfa-81a7-40ba-a9a8-a207890c2528',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.312854] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.312854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.312854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.312854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.312854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.312854] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.312854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.312854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.312854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.312854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.312854] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 is going to be updated. [ 816.360509] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.360839] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.360839] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.361097] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.361410] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.379792] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 in Status: IN_PROGRESS for 2s [ 816.683733] env[66834]: INFO networking_nsxv3.common.synchronization [req-e2fbef81-8cff-4857-897c-0fc64dc209aa req-73c828fe-3637-40a3-b2b5-52da019b262e service nova] Enqueued Resource ID: b372a601-425a-4557-bfbf-2682fc337d0d with Priority: HIGHEST for action security_group_rules [ 816.683913] env[66834]: INFO networking_nsxv3.common.synchronization [req-e2fbef81-8cff-4857-897c-0fc64dc209aa req-73c828fe-3637-40a3-b2b5-52da019b262e service nova] Enqueued Resource ID: b372a601-425a-4557-bfbf-2682fc337d0d with Priority: HIGHEST for action security_group_members [ 816.684062] env[66834]: INFO networking_nsxv3.common.synchronization [req-e2fbef81-8cff-4857-897c-0fc64dc209aa req-73c828fe-3637-40a3-b2b5-52da019b262e service nova] Enqueued Resource ID: e70617a6-b23b-4608-ad48-40b40b34a411 with Priority: HIGHEST for action port [ 816.684711] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b372a601-425a-4557-bfbf-2682fc337d0d with Priority: HIGHEST for action security_group_rules [ 816.684892] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b372a601-425a-4557-bfbf-2682fc337d0d with Priority: HIGHEST for action security_group_members [ 816.684993] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e70617a6-b23b-4608-ad48-40b40b34a411 with Priority: HIGHEST for action port [ 816.686877] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b372a601-425a-4557-bfbf-2682fc337d0d taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.687061] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.687135] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.689211] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.689211] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b372a601-425a-4557-bfbf-2682fc337d0d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.691162] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-b372a601-425a-4557-bfbf-2682fc337d0d taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.691298] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.691374] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.691583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.691751] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.691854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.691915] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.693027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.693247] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.693413] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b372a601-425a-4557-bfbf-2682fc337d0d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.694474] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-e70617a6-b23b-4608-ad48-40b40b34a411 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.694656] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e70617a6-b23b-4608-ad48-40b40b34a411" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.694767] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e70617a6-b23b-4608-ad48-40b40b34a411" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.694985] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e70617a6-b23b-4608-ad48-40b40b34a411" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.695130] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e70617a6-b23b-4608-ad48-40b40b34a411',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.197563] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b372a601-425a-4557-bfbf-2682fc337d0d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.199942] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-b372a601-425a-4557-bfbf-2682fc337d0d taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.199942] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.199942] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e70617a6-b23b-4608-ad48-40b40b34a411 with status ACTIVE [ 817.199942] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.200284] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.200284] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.202042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.202042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.202042] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.202042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.202042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.202042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.202042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.202042] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.202042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.202042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.202042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.202042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.202042] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e70617a6-b23b-4608-ad48-40b40b34a411 is going to be updated. [ 817.328205] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.328205] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.328205] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.328559] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.328598] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.328752] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e70617a6-b23b-4608-ad48-40b40b34a411" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.704763] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b372a601-425a-4557-bfbf-2682fc337d0d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.734241] env[66834]: INFO networking_nsxv3.common.synchronization [req-6c5c9c99-c843-41ad-bc79-84dd9f8f83ac req-536fca4f-2899-476b-9e14-1abecb1a7049 tempest-ServersWithSpecificFlavorTestJSON-2029331566 tempest-ServersWithSpecificFlavorTestJSON-2029331566-project-member] Enqueued Resource ID: 9c3590f1-016a-4b00-b83e-f52f030b948b with Priority: HIGHEST for action security_group_members [ 817.735240] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c3590f1-016a-4b00-b83e-f52f030b948b with Priority: HIGHEST for action security_group_members [ 817.735569] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c3590f1-016a-4b00-b83e-f52f030b948b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.735693] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.735755] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.735957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.736124] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.736225] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.736288] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.736438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.736648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.736648] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c3590f1-016a-4b00-b83e-f52f030b948b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.189124] env[66834]: INFO networking_nsxv3.common.synchronization [req-e66ab557-cb3c-4957-bb3a-15d21ffedc9e req-957af07a-d634-4d44-8e2d-ca6811f45dc9 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: be6a78d7-b908-447c-a3f4-0f30c644939c with Priority: HIGHEST for action security_group_members [ 818.189366] env[66834]: INFO networking_nsxv3.common.synchronization [req-e66ab557-cb3c-4957-bb3a-15d21ffedc9e req-957af07a-d634-4d44-8e2d-ca6811f45dc9 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 with Priority: HIGHEST for action security_group_members [ 818.189438] env[66834]: INFO networking_nsxv3.common.synchronization [req-e66ab557-cb3c-4957-bb3a-15d21ffedc9e req-957af07a-d634-4d44-8e2d-ca6811f45dc9 tempest-SecurityGroupsTestJSON-602887837 tempest-SecurityGroupsTestJSON-602887837-project-member] Enqueued Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 818.190141] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be6a78d7-b908-447c-a3f4-0f30c644939c with Priority: HIGHEST for action security_group_members [ 818.190311] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 with Priority: HIGHEST for action security_group_members [ 818.190528] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGHEST for action security_group_members [ 818.191096] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-be6a78d7-b908-447c-a3f4-0f30c644939c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.191096] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.191096] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.191343] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.191343] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.191449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.191449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.191859] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.191859] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.191859] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be6a78d7-b908-447c-a3f4-0f30c644939c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.192611] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.192732] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.192795] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.192917] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.193870] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.193870] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.194028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.194069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.194230] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.194394] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c40be9d7-369b-4cf1-88e7-d822d62fa7f1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.195187] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.195290] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.195341] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.195810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.195810] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.195810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.195810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.196121] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.196230] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.196283] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.208152] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.208315] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.208389] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.208563] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.208647] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.208747] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b372a601-425a-4557-bfbf-2682fc337d0d is going to be created. [ 818.238767] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.239148] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.239271] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.239631] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.239781] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.240197] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.240318] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.240457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.240677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.240805] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.240927] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c3590f1-016a-4b00-b83e-f52f030b948b is going to be updated. [ 818.244789] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.244915] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.245674] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.245893] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.246096] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.256961] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b372a601-425a-4557-bfbf-2682fc337d0d in Status: UNINITIALIZED for 2s [ 818.275276] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.275411] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.275479] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.275680] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.276069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.290426] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c3590f1-016a-4b00-b83e-f52f030b948b in Status: IN_PROGRESS for 2s [ 818.393773] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 in Status: SUCCESS [ 818.394081] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 deletion is rescheduled due to dependency. [ 818.394081] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.627445] env[66834]: INFO networking_nsxv3.common.synchronization [req-f0d9103d-0b28-473b-907c-f4a688172ec7 req-4e07faec-c773-48f1-af12-027833355e43 tempest-ListServerFiltersTestJSON-1401422689 tempest-ListServerFiltersTestJSON-1401422689-project-member] Enqueued Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGHEST for action security_group_members [ 818.628057] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGHEST for action security_group_members [ 818.628386] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.628515] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.628566] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.629595] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.629595] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.629595] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.629595] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.629595] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.629595] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.629914] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.702385] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.702385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.702385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.702385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.702385] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.702385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.702385] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.702385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.750141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.750324] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.750434] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.750475] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.750690] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.750768] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.750865] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 is going to be updated. [ 818.756154] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.756288] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.756420] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.756855] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.756972] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.757056] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.757185] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.757351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.757544] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be6a78d7-b908-447c-a3f4-0f30c644939c is going to be updated. [ 818.758705] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.758877] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.758968] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.761124] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.761348] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.761467] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.761734] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.761804] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.762316] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21deb826-26b5-4246-96bf-34da6682babd is going to be updated. [ 818.817446] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.817604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.817716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.817884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.818042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.819902] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.820077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.822748] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.822999] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.823180] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.825109] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.825243] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.825293] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.825481] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.825649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.852029] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be6a78d7-b908-447c-a3f4-0f30c644939c in Status: IN_PROGRESS for 2s [ 818.853173] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: IN_PROGRESS for 2s [ 818.853755] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 in Status: IN_PROGRESS for 2s [ 819.134895] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.641667] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.144159] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.144434] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.144434] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.144943] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.144943] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.144943] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ce997a4-e173-41da-a149-86945dba84fe is going to be updated. [ 820.177251] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.177427] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.177496] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.177699] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.177840] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.189451] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ce997a4-e173-41da-a149-86945dba84fe in Status: IN_PROGRESS for 2s [ 820.270899] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b372a601-425a-4557-bfbf-2682fc337d0d in Status: SUCCESS [ 820.271068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.271172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.271391] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.271584] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.271730] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.271801] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.271944] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.272036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.272123] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.272217] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b372a601-425a-4557-bfbf-2682fc337d0d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.303852] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c3590f1-016a-4b00-b83e-f52f030b948b in Status: SUCCESS [ 820.303852] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c3590f1-016a-4b00-b83e-f52f030b948b deletion is rescheduled due to dependency. [ 820.303852] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.556053] env[66834]: INFO networking_nsxv3.common.synchronization [req-0d701f96-b851-424e-8beb-40e6eeb1114e req-b93f5b95-7168-44b9-bcc8-6eddd725ccd5 tempest-ServerMetadataTestJSON-1053450456 tempest-ServerMetadataTestJSON-1053450456-project-member] Enqueued Resource ID: 87920817-9bc0-40b2-945a-8057b5158162 with Priority: HIGHEST for action security_group_members [ 820.556618] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87920817-9bc0-40b2-945a-8057b5158162 with Priority: HIGHEST for action security_group_members [ 820.556916] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-87920817-9bc0-40b2-945a-8057b5158162 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.557047] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.557223] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.557750] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.557750] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.557750] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.557750] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.557960] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.557960] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.557960] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87920817-9bc0-40b2-945a-8057b5158162',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.776983] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b372a601-425a-4557-bfbf-2682fc337d0d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.867967] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21deb826-26b5-4246-96bf-34da6682babd in Status: SUCCESS [ 820.868374] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21deb826-26b5-4246-96bf-34da6682babd deletion is rescheduled due to dependency. [ 820.868374] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.869214] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be6a78d7-b908-447c-a3f4-0f30c644939c in Status: SUCCESS [ 820.869443] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be6a78d7-b908-447c-a3f4-0f30c644939c deletion is rescheduled due to dependency. [ 820.869550] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.870482] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 in Status: SUCCESS [ 820.870667] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 deletion is rescheduled due to dependency. [ 820.871167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.063240] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.063240] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.063240] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.063240] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.063240] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.063240] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.063240] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.063240] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.063240] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.063240] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.063240] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87920817-9bc0-40b2-945a-8057b5158162 is going to be updated. [ 821.099730] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.099730] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.099730] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.099730] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.099730] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.114927] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87920817-9bc0-40b2-945a-8057b5158162 in Status: IN_PROGRESS for 2s [ 821.281449] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b372a601-425a-4557-bfbf-2682fc337d0d: rpc.has_security_group_logging(os_id): False [ 821.303323] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.303508] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.304677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.304677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.304677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.304677] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.304677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.304677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.304677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.304677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.305207] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b372a601-425a-4557-bfbf-2682fc337d0d is going to be created. [ 821.376204] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.376364] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.376432] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.376753] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.376954] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.394581] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b372a601-425a-4557-bfbf-2682fc337d0d in Status: IN_PROGRESS for 2s [ 822.201449] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ce997a4-e173-41da-a149-86945dba84fe in Status: SUCCESS [ 822.201809] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.126234] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87920817-9bc0-40b2-945a-8057b5158162 in Status: SUCCESS [ 823.126432] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87920817-9bc0-40b2-945a-8057b5158162 deletion is rescheduled due to dependency. [ 823.126731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.401165] env[66834]: INFO networking_nsxv3.common.synchronization [req-95800844-40a6-4301-a7db-056543e05584 req-baaca750-b005-40bc-b2af-05dcfa648cf4 tempest-AttachInterfacesTestJSON-77868371 tempest-AttachInterfacesTestJSON-77868371-project-member] Enqueued Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 823.401745] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 823.402472] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.402625] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.402704] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.402994] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.403158] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.403249] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.403343] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.403458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.403549] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.403652] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.408488] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b372a601-425a-4557-bfbf-2682fc337d0d in Status: SUCCESS [ 823.408488] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.704938] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-106 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.705244] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.705461] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.705822] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.706219] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.706472] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.706754] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.707141] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.707287] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.707632] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.707798] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 823.708062] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 823.708277] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 823.708445] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.708623] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 823.708829] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 823.737607] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 823.737607] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 823.737846] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 823.737846] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.738497] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-92863b73-1ad1-4f2c-a5dc-88860d80e6c5 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.738985] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-92863b73-1ad1-4f2c-a5dc-88860d80e6c5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.738985] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-92863b73-1ad1-4f2c-a5dc-88860d80e6c5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.739574] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-92863b73-1ad1-4f2c-a5dc-88860d80e6c5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.739767] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92863b73-1ad1-4f2c-a5dc-88860d80e6c5',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.905670] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.905913] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.906022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.906339] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.906485] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.906708] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.906820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.906893] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.907089] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.907177] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.907393] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2989937c-6050-493e-a1d8-79a52d9b6132 already deleted. [ 823.907393] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.243914] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.244242] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.244367] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.244704] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.244903] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.245132] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 92863b73-1ad1-4f2c-a5dc-88860d80e6c5 not found, creating... [ 824.245518] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.245855] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.245979] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.246543] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.246751] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.247258] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.247448] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.247568] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.247815] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.247992] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.248309] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 92863b73-1ad1-4f2c-a5dc-88860d80e6c5 is going to be created. [ 824.276017] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.276525] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.276778] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.277212] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.278020] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.278020] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-92863b73-1ad1-4f2c-a5dc-88860d80e6c5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.471667] env[66834]: INFO networking_nsxv3.common.synchronization [req-daf8dbd2-7610-4aaa-88bf-d89e5172ca63 req-ad686a2e-4545-4737-b55e-bf6c8299f686 tempest-ServersTestManualDisk-242123046 tempest-ServersTestManualDisk-242123046-project-member] Enqueued Resource ID: b11bc7eb-c1bb-49d4-8347-38576752a094 with Priority: HIGHEST for action security_group_members [ 824.472188] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b11bc7eb-c1bb-49d4-8347-38576752a094 with Priority: HIGHEST for action security_group_members [ 824.472540] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-b11bc7eb-c1bb-49d4-8347-38576752a094 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.472689] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.472758] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.472979] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.473066] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.473169] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.473234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.473351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.473438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.473533] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b11bc7eb-c1bb-49d4-8347-38576752a094',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.976739] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.978056] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.978056] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.978056] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.978056] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.978372] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.978372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.978526] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.979451] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.979451] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.979451] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b11bc7eb-c1bb-49d4-8347-38576752a094 is going to be updated. [ 824.988641] env[66834]: INFO networking_nsxv3.common.synchronization [req-95800844-40a6-4301-a7db-056543e05584 req-6de0052f-ac28-4017-bce4-49d9a5d5d9c0 service nova] Enqueued Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_rules [ 824.990079] env[66834]: INFO networking_nsxv3.common.synchronization [req-95800844-40a6-4301-a7db-056543e05584 req-6de0052f-ac28-4017-bce4-49d9a5d5d9c0 service nova] Enqueued Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 824.990321] env[66834]: INFO networking_nsxv3.common.synchronization [req-95800844-40a6-4301-a7db-056543e05584 req-6de0052f-ac28-4017-bce4-49d9a5d5d9c0 service nova] Enqueued Resource ID: 92863b73-1ad1-4f2c-a5dc-88860d80e6c5 with Priority: HIGHEST for action port [ 824.991509] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_rules [ 824.991820] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 824.992039] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92863b73-1ad1-4f2c-a5dc-88860d80e6c5 with Priority: HIGHEST for action port [ 824.992651] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.993133] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.993510] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.994069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.994189] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.995590] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.995969] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.996245] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.996488] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.996675] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.996793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.996866] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.997951] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.997951] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.997951] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.999248] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-92863b73-1ad1-4f2c-a5dc-88860d80e6c5 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.999433] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92863b73-1ad1-4f2c-a5dc-88860d80e6c5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.999552] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92863b73-1ad1-4f2c-a5dc-88860d80e6c5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.999638] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92863b73-1ad1-4f2c-a5dc-88860d80e6c5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.999820] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92863b73-1ad1-4f2c-a5dc-88860d80e6c5',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.014699] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.014962] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.014962] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.015138] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.015268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.027383] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b11bc7eb-c1bb-49d4-8347-38576752a094 in Status: IN_PROGRESS for 2s [ 825.502302] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 92863b73-1ad1-4f2c-a5dc-88860d80e6c5 with status ACTIVE [ 825.506037] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.506037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.506037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.506037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.506037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.506037] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.506037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.506037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.506037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.506037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.506037] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.506037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.506037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.506037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.506037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.506037] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 92863b73-1ad1-4f2c-a5dc-88860d80e6c5 is going to be updated. [ 825.508257] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.508257] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.508414] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.516478] env[66834]: INFO networking_nsxv3.common.synchronization [req-2ae1887c-cd3d-4327-b6ab-2fcb88da18a7 req-ab4ea84e-6cdc-4dd9-a878-c5befd7fa048 tempest-ServerDiskConfigTestJSON-362503924 tempest-ServerDiskConfigTestJSON-362503924-project-member] Enqueued Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 825.517192] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 825.517457] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.517562] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.517609] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.518153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.518153] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.518303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.518303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.518550] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.518550] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.518653] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.536544] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.536761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.536835] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.537151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.537354] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.537720] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92863b73-1ad1-4f2c-a5dc-88860d80e6c5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.608491] env[66834]: INFO networking_nsxv3.common.synchronization [req-e45788fe-a3c8-403a-9b1d-27e0db562099 req-b9485ba6-709c-4452-8198-7341a44cd45a tempest-ServersTestJSON-2040502537 tempest-ServersTestJSON-2040502537-project-member] Enqueued Resource ID: 61dc46c7-365b-480f-83e5-16cbc578a879 with Priority: HIGHEST for action security_group_members [ 825.609045] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61dc46c7-365b-480f-83e5-16cbc578a879 with Priority: HIGHEST for action security_group_members [ 825.609411] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-61dc46c7-365b-480f-83e5-16cbc578a879 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.609546] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.609644] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.609846] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.612092] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.612250] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.612303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.612494] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.612612] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.612729] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61dc46c7-365b-480f-83e5-16cbc578a879',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.012065] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.021442] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.021754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.021754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.021925] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.022026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.022862] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.022862] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.022862] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.022862] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.022862] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.022862] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7963c125-23b5-45fd-8158-f6470d12949e is going to be updated. [ 826.060094] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.060094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.060094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.060385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.060385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.073660] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: IN_PROGRESS for 2s [ 826.112650] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-98 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.113036] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-98" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.113216] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-98" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.113820] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-98" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.114397] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.114720] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.114994] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.115360] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.115601] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.115892] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 826.116039] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 826.116157] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 826.116258] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 826.116443] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 826.116543] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 826.116745] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 826.118755] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.118995] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.118995] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.119244] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.145488] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 826.145488] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 826.145900] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 826.145900] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-98" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.146228] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-9cb795ef-d274-4d6b-abd2-cc29b9a02260 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.146453] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-9cb795ef-d274-4d6b-abd2-cc29b9a02260" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.146849] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-9cb795ef-d274-4d6b-abd2-cc29b9a02260" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.147315] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-9cb795ef-d274-4d6b-abd2-cc29b9a02260" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.147315] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cb795ef-d274-4d6b-abd2-cc29b9a02260',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.150302] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.150521] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.150675] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.150675] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.150869] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.151056] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.151056] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61dc46c7-365b-480f-83e5-16cbc578a879 is going to be updated. [ 826.185124] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.185299] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.185378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.185553] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.185699] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.197546] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61dc46c7-365b-480f-83e5-16cbc578a879 in Status: IN_PROGRESS for 2s [ 826.514471] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.514873] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.514873] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.514873] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.515031] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.515031] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2989937c-6050-493e-a1d8-79a52d9b6132 is going to be created. [ 826.542149] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.542364] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.542364] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.542736] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.542911] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.554939] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: UNINITIALIZED for 2s [ 826.650771] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.651044] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.651193] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.651511] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.651683] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.651865] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 9cb795ef-d274-4d6b-abd2-cc29b9a02260 not found, creating... [ 826.652179] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.652345] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.652547] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.652831] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.652994] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.653330] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.653497] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.653655] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.653872] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.654051] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.654229] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 9cb795ef-d274-4d6b-abd2-cc29b9a02260 is going to be created. [ 826.677367] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.677639] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.677742] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.678103] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.678346] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.678603] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-9cb795ef-d274-4d6b-abd2-cc29b9a02260" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.039664] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b11bc7eb-c1bb-49d4-8347-38576752a094 in Status: SUCCESS [ 827.039919] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b11bc7eb-c1bb-49d4-8347-38576752a094 deletion is rescheduled due to dependency. [ 827.040032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.384886] env[66834]: INFO networking_nsxv3.common.synchronization [req-2ae1887c-cd3d-4327-b6ab-2fcb88da18a7 req-8c4760c2-3493-4d1f-afe1-dca99caccf21 service nova] Enqueued Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_rules [ 827.385076] env[66834]: INFO networking_nsxv3.common.synchronization [req-2ae1887c-cd3d-4327-b6ab-2fcb88da18a7 req-8c4760c2-3493-4d1f-afe1-dca99caccf21 service nova] Enqueued Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 827.385267] env[66834]: INFO networking_nsxv3.common.synchronization [req-2ae1887c-cd3d-4327-b6ab-2fcb88da18a7 req-8c4760c2-3493-4d1f-afe1-dca99caccf21 service nova] Enqueued Resource ID: 9cb795ef-d274-4d6b-abd2-cc29b9a02260 with Priority: HIGHEST for action port [ 827.386146] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_rules [ 827.386268] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 827.386416] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cb795ef-d274-4d6b-abd2-cc29b9a02260 with Priority: HIGHEST for action port [ 827.387458] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.387604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.387683] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.390066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.390066] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.390066] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.390066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.390066] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cb795ef-d274-4d6b-abd2-cc29b9a02260 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.390066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cb795ef-d274-4d6b-abd2-cc29b9a02260" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.390066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cb795ef-d274-4d6b-abd2-cc29b9a02260" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.390066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cb795ef-d274-4d6b-abd2-cc29b9a02260" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.390066] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cb795ef-d274-4d6b-abd2-cc29b9a02260',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.779572] env[66834]: INFO networking_nsxv3.common.synchronization [None req-7fbd2811-ff4f-42c0-8143-d0ee24a2c4ea None None] Enqueued Resource ID: 2d2bca11-caa3-4a16-9b37-ddbc66b49b15 with Priority: HIGHEST for action port [ 827.780437] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d2bca11-caa3-4a16-9b37-ddbc66b49b15 with Priority: HIGHEST for action port [ 827.782648] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d2bca11-caa3-4a16-9b37-ddbc66b49b15 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.782856] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d2bca11-caa3-4a16-9b37-ddbc66b49b15" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.782948] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d2bca11-caa3-4a16-9b37-ddbc66b49b15" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.783454] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d2bca11-caa3-4a16-9b37-ddbc66b49b15" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.783574] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d2bca11-caa3-4a16-9b37-ddbc66b49b15',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.893298] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9cb795ef-d274-4d6b-abd2-cc29b9a02260 with status ACTIVE [ 827.893298] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.893298] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.893443] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.894069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.894069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.894069] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.894069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.894069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.894626] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.894626] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.894626] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.894626] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.894986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.895203] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.895265] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.895340] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9cb795ef-d274-4d6b-abd2-cc29b9a02260 is going to be updated. [ 827.896656] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.896785] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.930400] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.930580] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.930650] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.930932] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.931522] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.931522] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cb795ef-d274-4d6b-abd2-cc29b9a02260" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.087218] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: SUCCESS [ 828.087575] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7963c125-23b5-45fd-8158-f6470d12949e deletion is rescheduled due to dependency. [ 828.087912] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.088041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.088409] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.088532] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.088766] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.088766] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.089012] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.089205] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.089501] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.210853] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61dc46c7-365b-480f-83e5-16cbc578a879 in Status: SUCCESS [ 828.211353] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61dc46c7-365b-480f-83e5-16cbc578a879 deletion is rescheduled due to dependency. [ 828.211353] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61dc46c7-365b-480f-83e5-16cbc578a879" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.286301] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d2bca11-caa3-4a16-9b37-ddbc66b49b15 [ 828.286465] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.286603] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.286652] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.286884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.286982] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.287108] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d2bca11-caa3-4a16-9b37-ddbc66b49b15 already deleted. [ 828.287195] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d2bca11-caa3-4a16-9b37-ddbc66b49b15" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.568362] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: SUCCESS [ 828.572022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.572022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.572022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.572022] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.572022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.572022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.572022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.572022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.572022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.572022] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.595481] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.075398] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.075689] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.075689] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.075907] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.076164] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.076396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.076492] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.076786] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.076955] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.077142] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.077404] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.077654] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.077724] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.077925] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.078126] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.078255] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.078318] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.078466] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.078677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.078677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.078781] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.098593] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.581528] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2989937c-6050-493e-a1d8-79a52d9b6132: rpc.has_security_group_logging(os_id): False [ 829.602591] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.602745] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.602814] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.603051] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.603145] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.603366] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.603465] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.603528] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.603683] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.603772] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.603945] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.604047] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.604100] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.604269] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.604331] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.604511] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.604603] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.604661] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.604797] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.604866] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.604948] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2989937c-6050-493e-a1d8-79a52d9b6132 is going to be created. [ 829.606318] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.606481] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.606481] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.606642] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.606717] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.606881] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7963c125-23b5-45fd-8158-f6470d12949e is going to be updated. [ 829.644507] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.644507] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.644718] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.644852] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.644986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.656129] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: IN_PROGRESS for 2s [ 829.680671] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.680830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.680997] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.682329] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.682329] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.694755] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: IN_PROGRESS for 2s [ 830.033187] env[66834]: INFO networking_nsxv3.common.synchronization [None req-49754a05-2c42-4412-b4a3-1e739887e7ac None None] Enqueued Resource ID: 7798c120-3d62-4305-9949-145a198e6584 with Priority: HIGHEST for action port [ 830.033549] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7798c120-3d62-4305-9949-145a198e6584 with Priority: HIGHEST for action port [ 830.033861] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-7798c120-3d62-4305-9949-145a198e6584 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.034033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7798c120-3d62-4305-9949-145a198e6584" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.034113] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7798c120-3d62-4305-9949-145a198e6584" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.034394] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7798c120-3d62-4305-9949-145a198e6584" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.034469] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7798c120-3d62-4305-9949-145a198e6584',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.536547] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7798c120-3d62-4305-9949-145a198e6584 [ 830.536913] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.536913] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.537030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.537216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.537321] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.537491] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7798c120-3d62-4305-9949-145a198e6584 already deleted. [ 830.537579] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7798c120-3d62-4305-9949-145a198e6584" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.602015] env[66834]: INFO networking_nsxv3.common.synchronization [req-cc18e256-7872-4cc9-ac1e-6f7c3f1c91f4 req-c9dc34e4-7948-4609-9018-f70207ba7003 tempest-ImagesOneServerNegativeTestJSON-1609959325 tempest-ImagesOneServerNegativeTestJSON-1609959325-project-member] Enqueued Resource ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 with Priority: HIGHEST for action security_group_members [ 830.602382] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 with Priority: HIGHEST for action security_group_members [ 830.602696] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.602822] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.602894] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.603420] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.603600] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.603710] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.603795] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.604309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.604436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.604547] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.108707] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.108707] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.108707] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.108707] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.132087] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.132478] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.132663] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.132758] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.133059] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.133166] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.133284] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 is going to be updated. [ 831.158154] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-479 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.158375] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-479" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.158497] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-479" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.158774] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-479" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.163124] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.163432] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.163529] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.163813] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.163969] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.164199] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 831.164303] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 831.164408] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 831.164511] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 831.164614] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 831.164715] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 831.164846] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 831.169764] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.169912] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.169971] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.170238] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.170432] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.185580] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 in Status: IN_PROGRESS for 2s [ 831.192820] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 831.192985] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 831.193133] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 831.193312] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-479" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.193662] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-d56ea2b7-5069-4c1c-93f2-966267ce100d taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.193905] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-d56ea2b7-5069-4c1c-93f2-966267ce100d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.194045] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-d56ea2b7-5069-4c1c-93f2-966267ce100d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.194439] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-d56ea2b7-5069-4c1c-93f2-966267ce100d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.194725] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d56ea2b7-5069-4c1c-93f2-966267ce100d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.373601] env[66834]: INFO networking_nsxv3.common.synchronization [None req-adb5ac22-00e8-47a3-ae14-796c59b2d818 tempest-ServersV294TestFqdnHostnames-945274817 tempest-ServersV294TestFqdnHostnames-945274817-project-member] Enqueued Resource ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 with Priority: HIGHEST for action security_group_rules [ 831.374157] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 with Priority: HIGHEST for action security_group_rules [ 831.374519] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d437be3-ac8e-4142-becb-dfc82235f8e5 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.374592] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.374671] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.375013] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.375013] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d437be3-ac8e-4142-becb-dfc82235f8e5',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.476479] env[66834]: INFO networking_nsxv3.common.synchronization [None req-65ac2431-a3ed-4640-8536-9f855a9b0cf3 tempest-ServersV294TestFqdnHostnames-945274817 tempest-ServersV294TestFqdnHostnames-945274817-project-member] Enqueued Resource ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 with Priority: HIGHEST for action security_group_rules [ 831.477038] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 with Priority: HIGHEST for action security_group_rules [ 831.479701] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d437be3-ac8e-4142-becb-dfc82235f8e5 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.479701] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.671162] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: SUCCESS [ 831.671570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.671570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.671802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.672009] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.672317] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.672317] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.672458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.672458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.672540] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.672624] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.697901] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.698142] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.698261] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.698572] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.698764] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.698877] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port d56ea2b7-5069-4c1c-93f2-966267ce100d not found, creating... [ 831.699160] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.699317] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.699455] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.699731] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.699872] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.700168] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.700326] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.700555] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.700851] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.701062] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.701207] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: d56ea2b7-5069-4c1c-93f2-966267ce100d is going to be created. [ 831.726680] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: SUCCESS [ 831.726996] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.730694] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.730977] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.731112] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.731383] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.731613] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.731858] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-d56ea2b7-5069-4c1c-93f2-966267ce100d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.901898] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.901898] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.901898] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.901898] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.901898] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.901898] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 already deleted. [ 831.901898] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.901898] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.901898] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.901898] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d437be3-ac8e-4142-becb-dfc82235f8e5',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.175092] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.175262] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.175334] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.175560] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.175729] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.175834] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.175922] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.176129] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.176187] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.176294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.176461] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.176519] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.176643] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.176696] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.176832] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.176925] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.176984] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.177175] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.177251] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.177371] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.177475] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.425527] env[66834]: INFO networking_nsxv3.common.synchronization [req-cc18e256-7872-4cc9-ac1e-6f7c3f1c91f4 req-5f05b28c-22db-48a1-82df-10e5c42a0455 service nova] Enqueued Resource ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 with Priority: HIGHEST for action security_group_rules [ 832.425719] env[66834]: INFO networking_nsxv3.common.synchronization [req-cc18e256-7872-4cc9-ac1e-6f7c3f1c91f4 req-5f05b28c-22db-48a1-82df-10e5c42a0455 service nova] Enqueued Resource ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 with Priority: HIGHEST for action security_group_members [ 832.425855] env[66834]: INFO networking_nsxv3.common.synchronization [req-cc18e256-7872-4cc9-ac1e-6f7c3f1c91f4 req-5f05b28c-22db-48a1-82df-10e5c42a0455 service nova] Enqueued Resource ID: d56ea2b7-5069-4c1c-93f2-966267ce100d with Priority: HIGHEST for action port [ 832.426990] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.427184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.427258] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.427500] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.427549] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.427629] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 already deleted. [ 832.427714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.428251] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 with Priority: HIGHEST for action security_group_rules [ 832.428388] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 with Priority: HIGHEST for action security_group_members [ 832.428484] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d56ea2b7-5069-4c1c-93f2-966267ce100d with Priority: HIGHEST for action port [ 832.428750] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.428855] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.428919] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.429118] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.429206] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.430275] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.430389] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.430735] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-d56ea2b7-5069-4c1c-93f2-966267ce100d taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.430735] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d56ea2b7-5069-4c1c-93f2-966267ce100d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.430957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d56ea2b7-5069-4c1c-93f2-966267ce100d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.430957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d56ea2b7-5069-4c1c-93f2-966267ce100d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.431059] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d56ea2b7-5069-4c1c-93f2-966267ce100d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.680360] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7963c125-23b5-45fd-8158-f6470d12949e: rpc.has_security_group_logging(os_id): False [ 832.700124] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.700124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.700124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.700124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.700124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.700736] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.700736] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.700736] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.700736] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.700736] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.700958] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.701029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.701068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.701198] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.701266] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.701440] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.701712] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.701801] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.701942] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.702010] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.702150] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7963c125-23b5-45fd-8158-f6470d12949e is going to be updated. [ 832.765258] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.765462] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.765462] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.765649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.765794] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.780311] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: IN_PROGRESS for 2s [ 832.934658] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.934739] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.935081] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d56ea2b7-5069-4c1c-93f2-966267ce100d with status ACTIVE [ 832.935081] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.935227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.935267] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.935506] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.935611] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.935779] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.935889] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.935933] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.936105] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.936184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.936376] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.936477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.936546] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.936674] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.936760] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.936894] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d56ea2b7-5069-4c1c-93f2-966267ce100d is going to be updated. [ 832.958173] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.958309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.958367] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.958608] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.959609] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.959609] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d56ea2b7-5069-4c1c-93f2-966267ce100d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.198068] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 in Status: SUCCESS [ 833.199149] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 deletion is rescheduled due to dependency. [ 833.199149] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.199149] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.199149] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.199361] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.199530] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.199595] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.199798] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.199957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.200071] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.703242] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.205432] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.708698] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.709330] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.709330] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.709330] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.709330] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.709330] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 is going to be updated. [ 834.743260] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.743260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.743525] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.743525] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.743671] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.755626] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 in Status: IN_PROGRESS for 2s [ 834.798146] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: SUCCESS [ 834.798375] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.766359] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 in Status: SUCCESS [ 836.766788] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.766788] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.767107] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.767301] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.767484] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.767638] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.767861] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.767978] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.768334] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.768334] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.272947] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.272947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.272947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.272947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.272947] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.272947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.272947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.272947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.272947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.272947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.272947] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.272947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.272947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.272947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.272947] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.272947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.273802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.273802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.273802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.273802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.273802] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.430949] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 837.431130] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 837.776070] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4: rpc.has_security_group_logging(os_id): False [ 837.795965] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.795965] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.796181] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.796274] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.796367] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.796547] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.796663] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.796716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.796901] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.797143] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.797272] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.797272] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.797369] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.797505] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.797574] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.797759] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.797847] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.797900] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.798043] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.798110] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.798189] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 is going to be updated. [ 837.859666] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.860762] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.860762] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.860762] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.860762] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.875480] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 in Status: IN_PROGRESS for 2s [ 839.893126] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 in Status: SUCCESS [ 839.893372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.220009] env[66834]: INFO networking_nsxv3.common.synchronization [req-1426fc56-3c79-4f6c-b6b7-0129a213b109 req-e0acb2de-2e3f-44a4-a1bf-95eceb6faec6 tempest-AttachInterfacesTestJSON-77868371 tempest-AttachInterfacesTestJSON-77868371-project-member] Enqueued Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 841.220622] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 841.220934] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.221087] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.221146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.221341] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.221663] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.221663] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.221663] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.221845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.221885] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.222138] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.726062] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.726249] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.726249] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.726709] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.726709] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.726909] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.726909] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.726909] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.727052] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.727107] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.727188] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2989937c-6050-493e-a1d8-79a52d9b6132 is going to be updated. [ 841.757930] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.759248] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.759248] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.759248] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.759248] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.769913] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: IN_PROGRESS for 2s [ 843.516773] env[66834]: INFO networking_nsxv3.common.synchronization [req-79b66755-f1a4-49b7-b371-2777ecadc5cf req-8cfdeed8-e811-4a0c-9e82-b769d22404d8 tempest-ImagesOneServerNegativeTestJSON-1609959325 tempest-ImagesOneServerNegativeTestJSON-1609959325-project-member] Enqueued Resource ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 with Priority: HIGHEST for action security_group_members [ 843.517395] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 with Priority: HIGHEST for action security_group_members [ 843.517714] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.517835] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.517907] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.518359] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.518620] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.519012] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.519012] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.519197] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.519197] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.519266] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.787010] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: SUCCESS [ 843.787295] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2989937c-6050-493e-a1d8-79a52d9b6132 deletion is rescheduled due to dependency. [ 843.787415] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.023304] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.023502] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.023502] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.023780] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.023987] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.024224] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.024353] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.024432] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.024599] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.024703] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.024926] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 is going to be updated. [ 844.056128] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.056302] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.056637] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.056866] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.057030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.067316] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 in Status: IN_PROGRESS for 2s [ 844.531478] env[66834]: INFO networking_nsxv3.common.synchronization [req-a7ec857a-0e89-4f7d-a441-94f2c470eb6a req-2495c463-14df-4548-a0e2-bdd12f805b00 tempest-ServersAdminTestJSON-835845617 tempest-ServersAdminTestJSON-835845617-project-member] Enqueued Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_members [ 844.532024] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_members [ 844.532329] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.532453] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.532522] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.532708] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.532917] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.533040] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.534306] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.534482] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.534578] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.534677] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.688504] env[66834]: INFO networking_nsxv3.common.synchronization [req-322b5ba2-0cfa-4cc9-a775-c4da06e8626a req-95fcb4f4-a2cb-47ea-98c7-bc5c4d2a2a35 tempest-AttachInterfacesTestJSON-77868371 tempest-AttachInterfacesTestJSON-77868371-project-member] Enqueued Resource ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 with Priority: HIGHEST for action security_group_members [ 844.689321] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 with Priority: HIGHEST for action security_group_members [ 844.689810] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b0294dc-2245-46bf-a56e-f22fbf616a62 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.689810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.689810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.690075] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.690206] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.690301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.690378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.690587] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.690679] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.690775] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b0294dc-2245-46bf-a56e-f22fbf616a62',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.873466] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-958 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.873466] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-958" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.873731] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-958" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.873829] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-958" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.874518] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.874518] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.874518] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.874730] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.874769] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.875594] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.875594] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 844.875594] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 844.875594] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 844.875594] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.875594] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 844.875994] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 844.898979] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 844.898979] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 844.898979] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 844.898979] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-958" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.899799] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-d1c10b97-2c0d-4ee3-95e5-1e55dd448828 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.899799] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-d1c10b97-2c0d-4ee3-95e5-1e55dd448828" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.899799] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-d1c10b97-2c0d-4ee3-95e5-1e55dd448828" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.899799] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-d1c10b97-2c0d-4ee3-95e5-1e55dd448828" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.899988] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1c10b97-2c0d-4ee3-95e5-1e55dd448828',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.036704] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.193544] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.193662] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.193732] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.193955] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.194051] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.194252] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.194353] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.194415] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.194565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.194676] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.194769] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 is going to be updated. [ 845.224027] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.224174] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.224218] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.224452] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.224629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.234997] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 in Status: IN_PROGRESS for 2s [ 845.402699] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.402927] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.403061] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.403347] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.403490] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.403661] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port d1c10b97-2c0d-4ee3-95e5-1e55dd448828 not found, creating... [ 845.403909] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.404069] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.404185] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.404389] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.404520] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.404790] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.405428] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.405428] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.405428] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.405428] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.405662] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: d1c10b97-2c0d-4ee3-95e5-1e55dd448828 is going to be created. [ 845.428190] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.429718] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.429718] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.429718] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.429718] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.429718] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-d1c10b97-2c0d-4ee3-95e5-1e55dd448828" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.538689] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.043340] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.043492] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.043604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.043919] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.044051] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.044181] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9276c5a5-af43-4c6e-899f-c34039400160 is going to be updated. [ 846.078390] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 in Status: SUCCESS [ 846.078572] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4 deletion is rescheduled due to dependency. [ 846.078681] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.079656] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.079856] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.079856] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.080073] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.080215] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.089117] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: IN_PROGRESS for 2s [ 846.147163] env[66834]: INFO networking_nsxv3.common.synchronization [req-a7ec857a-0e89-4f7d-a441-94f2c470eb6a req-06f75e88-b929-44d0-9b35-6cd23b83c5e7 service nova] Enqueued Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_rules [ 846.147356] env[66834]: INFO networking_nsxv3.common.synchronization [req-a7ec857a-0e89-4f7d-a441-94f2c470eb6a req-06f75e88-b929-44d0-9b35-6cd23b83c5e7 service nova] Enqueued Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_members [ 846.147507] env[66834]: INFO networking_nsxv3.common.synchronization [req-a7ec857a-0e89-4f7d-a441-94f2c470eb6a req-06f75e88-b929-44d0-9b35-6cd23b83c5e7 service nova] Enqueued Resource ID: d1c10b97-2c0d-4ee3-95e5-1e55dd448828 with Priority: HIGHEST for action port [ 846.148316] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_rules [ 846.149144] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_members [ 846.149144] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1c10b97-2c0d-4ee3-95e5-1e55dd448828 with Priority: HIGHEST for action port [ 846.149144] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.149308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.149386] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.149876] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.149876] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.153645] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.153645] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.153993] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1c10b97-2c0d-4ee3-95e5-1e55dd448828 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.153993] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1c10b97-2c0d-4ee3-95e5-1e55dd448828" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.154143] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1c10b97-2c0d-4ee3-95e5-1e55dd448828" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.154269] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1c10b97-2c0d-4ee3-95e5-1e55dd448828" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.154355] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1c10b97-2c0d-4ee3-95e5-1e55dd448828',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.653777] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.654238] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.656617] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d1c10b97-2c0d-4ee3-95e5-1e55dd448828 with status ACTIVE [ 846.657926] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.657926] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.657926] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.657926] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.657926] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.657926] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.658686] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.658686] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.658686] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.658873] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.659324] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.660471] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.660579] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.660774] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.661349] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.661349] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d1c10b97-2c0d-4ee3-95e5-1e55dd448828 is going to be updated. [ 846.686180] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.686459] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.686512] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.686693] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.686834] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.686991] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1c10b97-2c0d-4ee3-95e5-1e55dd448828" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.247657] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 in Status: SUCCESS [ 847.247847] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 deletion is rescheduled due to dependency. [ 847.247961] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.103921] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: SUCCESS [ 848.103921] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.103921] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.103921] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.103921] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.103921] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.103921] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.103921] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.103921] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.104669] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.606584] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.109446] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.612980] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.613287] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.613287] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.613553] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.613656] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.613758] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9276c5a5-af43-4c6e-899f-c34039400160 is going to be updated. [ 849.645241] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.645415] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.645415] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.645687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.645737] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.659009] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: IN_PROGRESS for 2s [ 849.970034] env[66834]: INFO networking_nsxv3.common.synchronization [req-3c6a8b9b-4dfa-4353-9639-4b133d1043d8 req-4d319b71-8367-4d36-80b8-b439624ce27b tempest-ListServersNegativeTestJSON-1125916362 tempest-ListServersNegativeTestJSON-1125916362-project-member] Enqueued Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGHEST for action security_group_members [ 849.970623] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGHEST for action security_group_members [ 849.971039] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-15d6f6bb-21e8-4682-a53e-1cc4b255699f taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.971211] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.971211] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.972583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.972583] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.972583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.972583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.972583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.972583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.972583] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.358493] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.358787] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-842" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.358787] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-842" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.359142] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-842" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.359400] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.359579] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.359746] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.359974] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.361249] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.361721] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 850.361908] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 850.362079] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 850.362237] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 850.362395] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 850.362602] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 850.362814] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 850.383438] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 850.383666] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 850.384767] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 850.384767] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-842" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.384767] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-96f41975-7241-47c1-b441-e5b91bf52873 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.384767] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-96f41975-7241-47c1-b441-e5b91bf52873" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.384767] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-96f41975-7241-47c1-b441-e5b91bf52873" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.385085] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-96f41975-7241-47c1-b441-e5b91bf52873" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.385182] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96f41975-7241-47c1-b441-e5b91bf52873',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.476395] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.476395] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.476395] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.477013] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.477757] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.477757] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.477757] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.477969] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.477969] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.478145] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.478145] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f already deleted. [ 850.478240] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.888010] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.888291] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.888497] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.888842] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.889079] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.889661] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 96f41975-7241-47c1-b441-e5b91bf52873 not found, creating... [ 850.889702] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.889845] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.889971] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.890220] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.890353] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.890680] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.891092] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.891092] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.891201] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.891393] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.891469] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 96f41975-7241-47c1-b441-e5b91bf52873 is going to be created. [ 850.912944] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.913251] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.913343] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.913582] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.913831] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.914076] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-96f41975-7241-47c1-b441-e5b91bf52873" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.630993] env[66834]: INFO networking_nsxv3.common.synchronization [req-3c6a8b9b-4dfa-4353-9639-4b133d1043d8 req-d14279a8-b541-4766-bfc3-b4aa5fe68635 service nova] Enqueued Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGHEST for action security_group_rules [ 851.631293] env[66834]: INFO networking_nsxv3.common.synchronization [req-3c6a8b9b-4dfa-4353-9639-4b133d1043d8 req-d14279a8-b541-4766-bfc3-b4aa5fe68635 service nova] Enqueued Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGHEST for action security_group_members [ 851.631293] env[66834]: INFO networking_nsxv3.common.synchronization [req-3c6a8b9b-4dfa-4353-9639-4b133d1043d8 req-d14279a8-b541-4766-bfc3-b4aa5fe68635 service nova] Enqueued Resource ID: 96f41975-7241-47c1-b441-e5b91bf52873 with Priority: HIGHEST for action port [ 851.632210] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGHEST for action security_group_rules [ 851.632210] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGHEST for action security_group_members [ 851.632210] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96f41975-7241-47c1-b441-e5b91bf52873 with Priority: HIGHEST for action port [ 851.632495] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15d6f6bb-21e8-4682-a53e-1cc4b255699f taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.632565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.633068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.633068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.633068] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.634587] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-15d6f6bb-21e8-4682-a53e-1cc4b255699f taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.634923] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.634923] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.635041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.635216] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.635378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.635378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.635527] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.635649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.635686] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.636532] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-96f41975-7241-47c1-b441-e5b91bf52873 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.636663] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96f41975-7241-47c1-b441-e5b91bf52873" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.636755] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96f41975-7241-47c1-b441-e5b91bf52873" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.636910] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96f41975-7241-47c1-b441-e5b91bf52873" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.639353] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96f41975-7241-47c1-b441-e5b91bf52873',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.673672] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: SUCCESS [ 851.673672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.673672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.673672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.673672] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.673672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.673672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.673672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.673672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.673672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.673672] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.139064] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.140031] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-15d6f6bb-21e8-4682-a53e-1cc4b255699f taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.140031] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.140031] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96f41975-7241-47c1-b441-e5b91bf52873 with status ACTIVE [ 852.140299] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.140299] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.140299] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.140450] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.140527] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.140690] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.140785] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.140846] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.140991] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.141079] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.141254] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.141345] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.141403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.141539] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.141615] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.141696] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96f41975-7241-47c1-b441-e5b91bf52873 is going to be updated. [ 852.162652] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.163194] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.163310] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.163520] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.163666] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.163827] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96f41975-7241-47c1-b441-e5b91bf52873" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.175716] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.175892] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.175958] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.176347] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.176530] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.176635] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.176695] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.176854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.176940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.177034] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.177180] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.177272] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.177333] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.177495] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.177641] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.177740] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.177803] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.177933] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.178016] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.178105] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.178194] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.621193] env[66834]: INFO networking_nsxv3.common.synchronization [req-3c6a8b9b-4dfa-4353-9639-4b133d1043d8 req-58009649-fe86-40f3-b63d-359740355155 tempest-ListServersNegativeTestJSON-1125916362 tempest-ListServersNegativeTestJSON-1125916362-project-member] Enqueued Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGHEST for action security_group_members [ 852.621744] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGHEST for action security_group_members [ 852.622132] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-15d6f6bb-21e8-4682-a53e-1cc4b255699f taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.622262] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.645036] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.684346] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9276c5a5-af43-4c6e-899f-c34039400160: rpc.has_security_group_logging(os_id): False [ 852.708494] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.708651] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.708703] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.708934] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.709038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.709235] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.709338] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.709392] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.710106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.710106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.710106] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.710106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.710327] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.710327] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.710404] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.710559] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.710659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.710715] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.710872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.710947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.711047] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9276c5a5-af43-4c6e-899f-c34039400160 is going to be updated. [ 852.772445] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.772648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.772793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.773011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.773185] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.788695] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: IN_PROGRESS for 2s [ 852.982206] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.982403] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-842" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.982573] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-842" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.982775] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-842" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.983033] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.983188] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.983309] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.983510] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.983647] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.983850] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 852.983958] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 852.984243] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 852.984369] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 852.984482] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 852.984586] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 852.984714] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 853.003972] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 853.004179] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 853.004336] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 853.004532] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-842" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.004859] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-bfff3962-77e0-4b65-9e0a-453d3ae48643 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.005064] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-bfff3962-77e0-4b65-9e0a-453d3ae48643" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.005188] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-bfff3962-77e0-4b65-9e0a-453d3ae48643" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.005537] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-bfff3962-77e0-4b65-9e0a-453d3ae48643" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.005648] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfff3962-77e0-4b65-9e0a-453d3ae48643',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.147723] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.147723] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.147723] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.147966] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.148122] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.148335] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f is going to be created. [ 853.176057] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.176253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.177484] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.177484] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.177484] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.187292] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f in Status: UNINITIALIZED for 2s [ 853.509312] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.509614] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.509703] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.509979] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.510143] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.510293] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port bfff3962-77e0-4b65-9e0a-453d3ae48643 not found, creating... [ 853.510546] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.510734] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.510859] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.511164] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.511246] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.511529] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.511700] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.511841] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.512434] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.512542] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.512765] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: bfff3962-77e0-4b65-9e0a-453d3ae48643 is going to be created. [ 853.537028] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.537028] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.537028] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.537028] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.537028] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.537028] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-bfff3962-77e0-4b65-9e0a-453d3ae48643" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.258131] env[66834]: INFO networking_nsxv3.common.synchronization [req-3c6a8b9b-4dfa-4353-9639-4b133d1043d8 req-5fc428ee-c59e-4783-a476-5cf91db7e6d3 service nova] Enqueued Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGHEST for action security_group_rules [ 854.258408] env[66834]: INFO networking_nsxv3.common.synchronization [req-3c6a8b9b-4dfa-4353-9639-4b133d1043d8 req-5fc428ee-c59e-4783-a476-5cf91db7e6d3 service nova] Enqueued Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGHEST for action security_group_members [ 854.258453] env[66834]: INFO networking_nsxv3.common.synchronization [req-3c6a8b9b-4dfa-4353-9639-4b133d1043d8 req-5fc428ee-c59e-4783-a476-5cf91db7e6d3 service nova] Enqueued Resource ID: bfff3962-77e0-4b65-9e0a-453d3ae48643 with Priority: HIGHEST for action port [ 854.258939] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGHEST for action security_group_rules [ 854.259085] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGHEST for action security_group_members [ 854.259180] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfff3962-77e0-4b65-9e0a-453d3ae48643 with Priority: HIGHEST for action port [ 854.259438] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15d6f6bb-21e8-4682-a53e-1cc4b255699f taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.259572] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.259778] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-15d6f6bb-21e8-4682-a53e-1cc4b255699f taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.259883] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.260242] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfff3962-77e0-4b65-9e0a-453d3ae48643 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.260398] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfff3962-77e0-4b65-9e0a-453d3ae48643" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.260503] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfff3962-77e0-4b65-9e0a-453d3ae48643" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.260763] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfff3962-77e0-4b65-9e0a-453d3ae48643" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.260911] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfff3962-77e0-4b65-9e0a-453d3ae48643',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.764040] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bfff3962-77e0-4b65-9e0a-453d3ae48643 with status ACTIVE [ 854.764665] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.764665] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.764665] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.764862] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.764862] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.764986] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.765098] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.765590] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.765590] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.765590] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.765755] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.765755] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.765755] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.765906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.766207] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.766207] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bfff3962-77e0-4b65-9e0a-453d3ae48643 is going to be updated. [ 854.789940] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.790066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.790168] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.790345] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.790487] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.790692] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfff3962-77e0-4b65-9e0a-453d3ae48643" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.807653] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: SUCCESS [ 854.807882] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.197996] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f in Status: SUCCESS [ 855.198223] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.198387] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.198677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.199066] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.199252] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.199252] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.199521] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.199620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.199829] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.199889] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.200955] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.201373] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.201373] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.201522] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.201522] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.201662] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.201865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.201999] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.358932] env[66834]: INFO networking_nsxv3.common.synchronization [req-3c6a8b9b-4dfa-4353-9639-4b133d1043d8 req-24d0f2c5-d087-4ff0-807b-a897a4265422 tempest-ListServersNegativeTestJSON-1125916362 tempest-ListServersNegativeTestJSON-1125916362-project-member] Enqueued Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGHEST for action security_group_members [ 855.359617] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGHEST for action security_group_members [ 855.360680] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-15d6f6bb-21e8-4682-a53e-1cc4b255699f taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.360883] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.706184] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-15d6f6bb-21e8-4682-a53e-1cc4b255699f taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.706411] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.708059] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.713575] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.713807] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-842" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.713942] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-842" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.714250] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-842" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.714534] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.714744] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.714899] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.716304] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.716544] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.717636] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 855.717714] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 855.717955] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 855.718145] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 855.718803] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 855.718972] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 855.722053] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 855.743018] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 855.743218] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 855.743357] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 855.743537] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-842" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.743858] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-35c1c53b-0d0c-4a4b-ae51-24460538ae26 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.744046] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-35c1c53b-0d0c-4a4b-ae51-24460538ae26" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.744164] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-35c1c53b-0d0c-4a4b-ae51-24460538ae26" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.744577] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-35c1c53b-0d0c-4a4b-ae51-24460538ae26" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.744732] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35c1c53b-0d0c-4a4b-ae51-24460538ae26',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.210802] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.247088] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.247349] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.247480] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.247804] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.247976] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.248145] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 35c1c53b-0d0c-4a4b-ae51-24460538ae26 not found, creating... [ 856.248406] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.248589] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.248664] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.248879] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.249033] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.249307] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.249457] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.249597] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.249803] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.250177] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.250177] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 35c1c53b-0d0c-4a4b-ae51-24460538ae26 is going to be created. [ 856.271231] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.271454] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.271582] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.271816] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.272089] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.272324] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-35c1c53b-0d0c-4a4b-ae51-24460538ae26" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.714079] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.714079] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.714079] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.714079] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.714079] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.715309] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f is going to be updated. [ 856.773927] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.774407] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.774407] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.774551] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.774828] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.785500] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f in Status: IN_PROGRESS for 2s [ 856.991028] env[66834]: INFO networking_nsxv3.common.synchronization [req-3c6a8b9b-4dfa-4353-9639-4b133d1043d8 req-2943685d-4d87-4d9d-ab11-14f43ba98391 service nova] Enqueued Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGHEST for action security_group_rules [ 856.991028] env[66834]: INFO networking_nsxv3.common.synchronization [req-3c6a8b9b-4dfa-4353-9639-4b133d1043d8 req-2943685d-4d87-4d9d-ab11-14f43ba98391 service nova] Enqueued Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGHEST for action security_group_members [ 856.991028] env[66834]: INFO networking_nsxv3.common.synchronization [req-3c6a8b9b-4dfa-4353-9639-4b133d1043d8 req-2943685d-4d87-4d9d-ab11-14f43ba98391 service nova] Enqueued Resource ID: 35c1c53b-0d0c-4a4b-ae51-24460538ae26 with Priority: HIGHEST for action port [ 856.991028] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGHEST for action security_group_rules [ 856.991028] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGHEST for action security_group_members [ 856.991028] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35c1c53b-0d0c-4a4b-ae51-24460538ae26 with Priority: HIGHEST for action port [ 856.991028] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15d6f6bb-21e8-4682-a53e-1cc4b255699f taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.991028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.991028] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-15d6f6bb-21e8-4682-a53e-1cc4b255699f taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.991028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.991028] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-35c1c53b-0d0c-4a4b-ae51-24460538ae26 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.991028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35c1c53b-0d0c-4a4b-ae51-24460538ae26" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.991028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35c1c53b-0d0c-4a4b-ae51-24460538ae26" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.996261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35c1c53b-0d0c-4a4b-ae51-24460538ae26" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.996633] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35c1c53b-0d0c-4a4b-ae51-24460538ae26',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.501397] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35c1c53b-0d0c-4a4b-ae51-24460538ae26 with status ACTIVE [ 857.501567] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.501670] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.501723] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.501944] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.502073] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.502256] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.502357] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.502478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.502597] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.502654] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.502859] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.502944] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.503045] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.503120] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.503197] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.503389] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35c1c53b-0d0c-4a4b-ae51-24460538ae26 is going to be updated. [ 857.527905] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.527905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.527905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.527905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.527905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.528319] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35c1c53b-0d0c-4a4b-ae51-24460538ae26" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.799155] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f in Status: SUCCESS [ 858.799842] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.799842] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.799842] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.799989] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.800151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.800233] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.800398] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.801204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.801204] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.106539] env[66834]: INFO networking_nsxv3.common.synchronization [req-a36269a6-c015-4f7e-8533-24ec7aa0e00b req-21e31d54-bf13-4409-9826-9f04fae477cc tempest-ServersWithSpecificFlavorTestJSON-2029331566 tempest-ServersWithSpecificFlavorTestJSON-2029331566-project-member] Enqueued Resource ID: 9c3590f1-016a-4b00-b83e-f52f030b948b with Priority: HIGHEST for action security_group_members [ 859.107218] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c3590f1-016a-4b00-b83e-f52f030b948b with Priority: HIGHEST for action security_group_members [ 859.107844] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c3590f1-016a-4b00-b83e-f52f030b948b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.107972] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.108059] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.108260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.108620] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.108746] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.108809] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.108933] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.109018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.109113] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c3590f1-016a-4b00-b83e-f52f030b948b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.303363] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.611927] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.612139] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.612216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.613021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.613021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.613021] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.613021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.613021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.613021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.613308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.613308] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c3590f1-016a-4b00-b83e-f52f030b948b is going to be updated. [ 859.641108] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-316 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.641326] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-316" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.641448] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-316" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.641801] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-316" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.642550] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.642741] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.642861] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.643116] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.643262] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.643466] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 859.643578] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 859.643687] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 859.643795] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 859.643902] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 859.644025] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 859.644175] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 859.645880] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.645999] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.646080] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.646236] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.646557] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.660290] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c3590f1-016a-4b00-b83e-f52f030b948b in Status: IN_PROGRESS for 2s [ 859.672468] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 859.672636] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 859.672758] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 859.672923] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-316" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.673843] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-7a05d473-f4ff-4f2c-8518-c6c59ceb7850 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.673843] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-7a05d473-f4ff-4f2c-8518-c6c59ceb7850" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.673843] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-7a05d473-f4ff-4f2c-8518-c6c59ceb7850" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.674197] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-7a05d473-f4ff-4f2c-8518-c6c59ceb7850" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.674197] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a05d473-f4ff-4f2c-8518-c6c59ceb7850',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.807792] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.176333] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.176561] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.176699] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.176966] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.177128] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.177289] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 7a05d473-f4ff-4f2c-8518-c6c59ceb7850 not found, creating... [ 860.177666] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.177818] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.177973] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.178305] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.178448] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.178796] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.179465] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.179691] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.179951] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.180112] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.180259] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 7a05d473-f4ff-4f2c-8518-c6c59ceb7850 is going to be created. [ 860.201341] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.201698] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.201867] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.202207] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.202515] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.202785] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-7a05d473-f4ff-4f2c-8518-c6c59ceb7850" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.314456] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.314456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.314456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.314456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.314456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.314456] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f is going to be updated. [ 860.355568] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.355966] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.355966] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.356361] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.356361] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.382137] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f in Status: IN_PROGRESS for 2s [ 860.932317] env[66834]: INFO networking_nsxv3.common.synchronization [req-a36269a6-c015-4f7e-8533-24ec7aa0e00b req-834fdfdb-04a5-4942-9752-88f5989ab666 service nova] Enqueued Resource ID: 9c3590f1-016a-4b00-b83e-f52f030b948b with Priority: HIGHEST for action security_group_rules [ 860.932317] env[66834]: INFO networking_nsxv3.common.synchronization [req-a36269a6-c015-4f7e-8533-24ec7aa0e00b req-834fdfdb-04a5-4942-9752-88f5989ab666 service nova] Enqueued Resource ID: 9c3590f1-016a-4b00-b83e-f52f030b948b with Priority: HIGHEST for action security_group_members [ 860.932317] env[66834]: INFO networking_nsxv3.common.synchronization [req-a36269a6-c015-4f7e-8533-24ec7aa0e00b req-834fdfdb-04a5-4942-9752-88f5989ab666 service nova] Enqueued Resource ID: 7a05d473-f4ff-4f2c-8518-c6c59ceb7850 with Priority: HIGHEST for action port [ 860.938659] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c3590f1-016a-4b00-b83e-f52f030b948b with Priority: HIGHEST for action security_group_rules [ 860.938659] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c3590f1-016a-4b00-b83e-f52f030b948b with Priority: HIGHEST for action security_group_members [ 860.938659] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a05d473-f4ff-4f2c-8518-c6c59ceb7850 with Priority: HIGHEST for action port [ 860.938659] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c3590f1-016a-4b00-b83e-f52f030b948b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.938659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.939534] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.939534] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.939534] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c3590f1-016a-4b00-b83e-f52f030b948b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.941183] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c3590f1-016a-4b00-b83e-f52f030b948b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.941294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.941498] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a05d473-f4ff-4f2c-8518-c6c59ceb7850 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.942720] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a05d473-f4ff-4f2c-8518-c6c59ceb7850" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.942720] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a05d473-f4ff-4f2c-8518-c6c59ceb7850" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.942720] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a05d473-f4ff-4f2c-8518-c6c59ceb7850" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.942720] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a05d473-f4ff-4f2c-8518-c6c59ceb7850',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.442797] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c3590f1-016a-4b00-b83e-f52f030b948b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.442797] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.445108] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a05d473-f4ff-4f2c-8518-c6c59ceb7850 with status ACTIVE [ 861.445399] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.445671] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.445833] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.446151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.449021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.449021] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.449021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.449021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.449021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.449021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.449021] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.449021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.449021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.449021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.449021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.449021] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a05d473-f4ff-4f2c-8518-c6c59ceb7850 is going to be updated. [ 861.472875] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.472875] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.472875] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.472875] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.472875] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.472875] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a05d473-f4ff-4f2c-8518-c6c59ceb7850" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.675789] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c3590f1-016a-4b00-b83e-f52f030b948b in Status: SUCCESS [ 861.676052] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c3590f1-016a-4b00-b83e-f52f030b948b deletion is rescheduled due to dependency. [ 861.676179] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.676375] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.676601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.676843] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.676989] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.681020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.681020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.681020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.681020] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c3590f1-016a-4b00-b83e-f52f030b948b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.183023] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c3590f1-016a-4b00-b83e-f52f030b948b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.393110] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f in Status: SUCCESS [ 862.393453] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.393579] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.393821] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.394073] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.394209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.394276] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.394434] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.394516] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.395787] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.616675] env[66834]: INFO networking_nsxv3.common.synchronization [req-24a287a5-03b4-48e8-aca5-53a679ecc4a5 req-3b0e663e-ee9c-40ae-8fc4-cbe3860a430d tempest-ServersV294TestFqdnHostnames-945274817 tempest-ServersV294TestFqdnHostnames-945274817-project-member] Enqueued Resource ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 with Priority: HIGHEST for action security_group_members [ 862.617832] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 with Priority: HIGHEST for action security_group_members [ 862.617832] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d437be3-ac8e-4142-becb-dfc82235f8e5 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.617832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.617832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.618203] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.618702] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.619093] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.619217] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.619570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.619570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.619570] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d437be3-ac8e-4142-becb-dfc82235f8e5',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.685643] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c3590f1-016a-4b00-b83e-f52f030b948b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.899201] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.122848] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.123066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.123066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.123272] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.123382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.123594] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.123707] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.124549] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.124549] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.124549] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.124549] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 already deleted. [ 863.124549] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.189082] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.189332] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.189558] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.189905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.190165] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.190165] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c3590f1-016a-4b00-b83e-f52f030b948b is going to be updated. [ 863.223555] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.224041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.224183] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.224449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.224719] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.234083] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c3590f1-016a-4b00-b83e-f52f030b948b in Status: IN_PROGRESS for 2s [ 863.385899] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-254 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.385899] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-254" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.385899] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-254" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.385899] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-254" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.386382] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.386544] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.386660] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.386897] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.387062] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.387274] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 863.387386] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 863.387547] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 863.387649] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 863.387798] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 863.387915] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 863.388060] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 863.403182] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.411664] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 863.411810] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 863.412919] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 863.412919] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-254" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.412919] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-738726b2-87ea-43b1-a09b-3000673ad943 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.412919] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-738726b2-87ea-43b1-a09b-3000673ad943" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.412919] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-738726b2-87ea-43b1-a09b-3000673ad943" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.413440] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-738726b2-87ea-43b1-a09b-3000673ad943" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.413486] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('738726b2-87ea-43b1-a09b-3000673ad943',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.906922] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.907253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.907253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.907487] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.907693] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.907843] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f is going to be updated. [ 863.916149] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.917585] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.917836] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.918531] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.918531] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.918531] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 738726b2-87ea-43b1-a09b-3000673ad943 not found, creating... [ 863.918887] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.919321] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.919321] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.920159] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.920159] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.920159] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.920384] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.920521] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.920770] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.921889] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.921889] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 738726b2-87ea-43b1-a09b-3000673ad943 is going to be created. [ 863.955347] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.955563] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.955716] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.955993] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.956256] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.956497] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-738726b2-87ea-43b1-a09b-3000673ad943" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.961259] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.961516] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.961594] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.961958] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.962226] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.975019] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f in Status: IN_PROGRESS for 2s [ 864.664147] env[66834]: INFO networking_nsxv3.common.synchronization [req-24a287a5-03b4-48e8-aca5-53a679ecc4a5 req-9250d6a7-2ce2-4ebc-8393-41e36922ba10 service nova] Enqueued Resource ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 with Priority: HIGHEST for action security_group_rules [ 864.664439] env[66834]: INFO networking_nsxv3.common.synchronization [req-24a287a5-03b4-48e8-aca5-53a679ecc4a5 req-9250d6a7-2ce2-4ebc-8393-41e36922ba10 service nova] Enqueued Resource ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 with Priority: HIGHEST for action security_group_members [ 864.664439] env[66834]: INFO networking_nsxv3.common.synchronization [req-24a287a5-03b4-48e8-aca5-53a679ecc4a5 req-9250d6a7-2ce2-4ebc-8393-41e36922ba10 service nova] Enqueued Resource ID: 738726b2-87ea-43b1-a09b-3000673ad943 with Priority: HIGHEST for action port [ 864.665117] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 with Priority: HIGHEST for action security_group_rules [ 864.665180] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 with Priority: HIGHEST for action security_group_members [ 864.665405] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 738726b2-87ea-43b1-a09b-3000673ad943 with Priority: HIGHEST for action port [ 864.665595] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d437be3-ac8e-4142-becb-dfc82235f8e5 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.665736] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.665790] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.666502] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.666640] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d437be3-ac8e-4142-becb-dfc82235f8e5',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.667878] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d437be3-ac8e-4142-becb-dfc82235f8e5 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.668086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.668146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.668301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.668455] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.668547] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.668607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.668746] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.668829] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.669307] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d437be3-ac8e-4142-becb-dfc82235f8e5',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.670686] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-738726b2-87ea-43b1-a09b-3000673ad943 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.670808] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-738726b2-87ea-43b1-a09b-3000673ad943" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.670939] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-738726b2-87ea-43b1-a09b-3000673ad943" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.671125] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-738726b2-87ea-43b1-a09b-3000673ad943" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.671225] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('738726b2-87ea-43b1-a09b-3000673ad943',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.174154] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d437be3-ac8e-4142-becb-dfc82235f8e5 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.174405] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.174556] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d437be3-ac8e-4142-becb-dfc82235f8e5',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.177669] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 738726b2-87ea-43b1-a09b-3000673ad943 with status ACTIVE [ 865.177669] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.177669] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.177669] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.177669] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.177669] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.178303] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.178303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.178303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.178689] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.178689] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.179100] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.179232] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.179299] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.180129] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.180129] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.180129] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 738726b2-87ea-43b1-a09b-3000673ad943 is going to be updated. [ 865.204993] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.205137] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.205631] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.205631] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.205631] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.205846] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-738726b2-87ea-43b1-a09b-3000673ad943" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.247024] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c3590f1-016a-4b00-b83e-f52f030b948b in Status: SUCCESS [ 865.247024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.247024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.247024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.247024] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.247024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.247024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.247499] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.247499] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.247499] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.247499] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c3590f1-016a-4b00-b83e-f52f030b948b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.677371] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d437be3-ac8e-4142-becb-dfc82235f8e5',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.729413] env[66834]: INFO networking_nsxv3.common.synchronization [None req-dda59102-9e54-40e4-8cb4-80aeb33e720f None None] Enqueued Resource ID: f2c2eade-402a-408c-9c38-5744fcf60303 with Priority: HIGHEST for action port [ 865.730409] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2c2eade-402a-408c-9c38-5744fcf60303 with Priority: HIGHEST for action port [ 865.730575] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2c2eade-402a-408c-9c38-5744fcf60303 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.730702] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2c2eade-402a-408c-9c38-5744fcf60303" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.730872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2c2eade-402a-408c-9c38-5744fcf60303" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.731164] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2c2eade-402a-408c-9c38-5744fcf60303" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.731245] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2c2eade-402a-408c-9c38-5744fcf60303',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.754395] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c3590f1-016a-4b00-b83e-f52f030b948b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.987031] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f in Status: SUCCESS [ 865.988086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.988086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.988086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.988086] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.988342] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.988342] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.988495] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.988567] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.988608] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.989082] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-15d6f6bb-21e8-4682-a53e-1cc4b255699f taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.989082] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.989082] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.989312] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.989312] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.989597] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.989597] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.989597] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.990922] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.990922] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.990922] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.990922] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.990922] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.991171] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.991171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.991292] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.991391] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.991455] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.991545] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.181135] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.181367] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.181367] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.181649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.181649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.181770] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 is going to be created. [ 866.205375] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.205536] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.205597] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.205830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.205998] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.215801] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 in Status: UNINITIALIZED for 2s [ 866.233302] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f2c2eade-402a-408c-9c38-5744fcf60303 [ 866.233539] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.233677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.233750] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.233950] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.234051] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.234145] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f2c2eade-402a-408c-9c38-5744fcf60303 already deleted. [ 866.234261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2c2eade-402a-408c-9c38-5744fcf60303" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.257437] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c3590f1-016a-4b00-b83e-f52f030b948b: rpc.has_security_group_logging(os_id): False [ 866.279720] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.279941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.280107] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.280467] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.280670] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.280957] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.281139] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.281244] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.281452] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.281576] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.281720] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c3590f1-016a-4b00-b83e-f52f030b948b is going to be updated. [ 866.344815] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.345038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.345038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.345241] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.345399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.365442] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c3590f1-016a-4b00-b83e-f52f030b948b in Status: IN_PROGRESS for 2s [ 866.494582] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15d6f6bb-21e8-4682-a53e-1cc4b255699f: rpc.has_security_group_logging(os_id): False [ 866.495606] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.522193] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.522525] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.522525] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.522708] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.523343] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.523343] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.523343] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.523343] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.523343] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.524268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.524268] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.524268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.524268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.524268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.524268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.524268] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.524870] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.524870] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.524870] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.524870] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.524870] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f is going to be created. [ 866.595449] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.595556] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.595668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.595949] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.596221] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.611356] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f in Status: IN_PROGRESS for 2s [ 867.000588] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.367118] env[66834]: INFO networking_nsxv3.common.synchronization [req-4705f3dc-827d-4fb1-a15f-0f0f6cf4ffb8 req-cb5d4bd8-19d6-4a06-b61f-a326e48756cf tempest-DeleteServersTestJSON-1250802255 tempest-DeleteServersTestJSON-1250802255-project-member] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 867.367640] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 867.367978] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.368620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.368955] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.369160] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.369280] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.369362] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.369484] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.369710] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.369839] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.369936] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.503313] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.503518] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.503818] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.504114] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.504262] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.504404] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f is going to be updated. [ 867.508161] env[66834]: INFO networking_nsxv3.common.synchronization [req-dde2e88f-eeb1-45f9-8053-9239ea560aae req-fc822733-f57b-492b-9ac0-251576287d5f tempest-ListServerFiltersTestJSON-1401422689 tempest-ListServerFiltersTestJSON-1401422689-project-member] Enqueued Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGHEST for action security_group_members [ 867.509398] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGHEST for action security_group_members [ 867.510070] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.510318] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.510483] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.510746] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.510990] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.511174] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.511582] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.511905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.512464] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.512583] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.538348] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.538507] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.538555] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.538829] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.541153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.553867] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f in Status: IN_PROGRESS for 2s [ 867.874892] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.874892] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.874892] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.874892] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.875237] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.875237] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.875237] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.875374] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.875480] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.875553] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.875590] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be updated. [ 867.919806] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.920023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.920161] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.920511] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.921035] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.936874] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: IN_PROGRESS for 2s [ 868.015167] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.228221] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 in Status: SUCCESS [ 868.228927] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.228927] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.228927] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.229158] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.229230] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.229230] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.229383] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.229457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.229554] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.229645] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d437be3-ac8e-4142-becb-dfc82235f8e5',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.378966] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c3590f1-016a-4b00-b83e-f52f030b948b in Status: SUCCESS [ 868.379237] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.383887] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-606 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.384111] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.384289] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.384597] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.384914] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.385118] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.385272] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.385577] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.385869] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.386222] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 868.386366] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 868.386483] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 868.386586] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 868.386716] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 868.386823] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 868.387231] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 868.411188] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 868.411445] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 868.411595] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 868.412152] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.412525] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-d18fcbca-b8fe-4958-a51d-88e2cfa86ac4 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.412701] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-d18fcbca-b8fe-4958-a51d-88e2cfa86ac4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.412839] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-d18fcbca-b8fe-4958-a51d-88e2cfa86ac4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.413320] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-d18fcbca-b8fe-4958-a51d-88e2cfa86ac4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.413603] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d18fcbca-b8fe-4958-a51d-88e2cfa86ac4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.522281] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.541192] env[66834]: INFO networking_nsxv3.common.synchronization [None req-7bf13172-2eee-4510-a840-8854633597d0 None None] Enqueued Resource ID: f3a9fbf8-cd56-4232-afcb-0579d9edcb80 with Priority: HIGHEST for action port [ 868.541704] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3a9fbf8-cd56-4232-afcb-0579d9edcb80 with Priority: HIGHEST for action port [ 868.542120] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3a9fbf8-cd56-4232-afcb-0579d9edcb80 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.542826] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3a9fbf8-cd56-4232-afcb-0579d9edcb80" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.542947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3a9fbf8-cd56-4232-afcb-0579d9edcb80" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.543253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3a9fbf8-cd56-4232-afcb-0579d9edcb80" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.543376] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3a9fbf8-cd56-4232-afcb-0579d9edcb80',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.632861] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f in Status: SUCCESS [ 868.633442] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.633686] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.633926] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.634027] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.736084] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d437be3-ac8e-4142-becb-dfc82235f8e5',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.917162] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.917422] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.917505] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.917950] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.918126] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.918290] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port d18fcbca-b8fe-4958-a51d-88e2cfa86ac4 not found, creating... [ 868.918571] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.918737] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.918854] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.919119] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.919259] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.919558] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.919777] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.919897] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.920148] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.920287] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.920431] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: d18fcbca-b8fe-4958-a51d-88e2cfa86ac4 is going to be created. [ 868.970116] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.970547] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.971642] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.971642] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.971642] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.971876] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-d18fcbca-b8fe-4958-a51d-88e2cfa86ac4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.025933] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.025933] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.025933] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.025933] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.025933] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.025933] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ce997a4-e173-41da-a149-86945dba84fe is going to be updated. [ 869.047862] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3a9fbf8-cd56-4232-afcb-0579d9edcb80 [ 869.047862] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.047862] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.047862] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.047862] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.047862] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.047862] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3a9fbf8-cd56-4232-afcb-0579d9edcb80 already deleted. [ 869.047862] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3a9fbf8-cd56-4232-afcb-0579d9edcb80" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.096376] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.096563] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.096609] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.096957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.097231] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.113067] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ce997a4-e173-41da-a149-86945dba84fe in Status: IN_PROGRESS for 2s [ 869.138534] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-15d6f6bb-21e8-4682-a53e-1cc4b255699f taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.138650] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.243873] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d437be3-ac8e-4142-becb-dfc82235f8e5: rpc.has_security_group_logging(os_id): False [ 869.264045] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.264302] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.264302] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.265261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.265261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.265261] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.265261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.265261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.265261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.265261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.265261] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 is going to be created. [ 869.333910] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.334017] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.334154] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.334336] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.334536] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.350339] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 in Status: IN_PROGRESS for 2s [ 869.565743] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f in Status: SUCCESS [ 869.566120] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.566219] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.566375] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.566674] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.566853] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.566942] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.567097] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.567182] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.567281] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.567380] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.686222] env[66834]: INFO networking_nsxv3.common.synchronization [req-4705f3dc-827d-4fb1-a15f-0f0f6cf4ffb8 req-17d9bcd9-4b65-4a1c-9d7f-96b27dba4b46 service nova] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_rules [ 869.686422] env[66834]: INFO networking_nsxv3.common.synchronization [req-4705f3dc-827d-4fb1-a15f-0f0f6cf4ffb8 req-17d9bcd9-4b65-4a1c-9d7f-96b27dba4b46 service nova] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 869.686560] env[66834]: INFO networking_nsxv3.common.synchronization [req-4705f3dc-827d-4fb1-a15f-0f0f6cf4ffb8 req-17d9bcd9-4b65-4a1c-9d7f-96b27dba4b46 service nova] Enqueued Resource ID: d18fcbca-b8fe-4958-a51d-88e2cfa86ac4 with Priority: HIGHEST for action port [ 869.687134] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_rules [ 869.687294] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 869.687399] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d18fcbca-b8fe-4958-a51d-88e2cfa86ac4 with Priority: HIGHEST for action port [ 869.687678] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.688911] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.688911] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.688911] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.688911] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.689201] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.689308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.689456] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-d18fcbca-b8fe-4958-a51d-88e2cfa86ac4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.689575] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d18fcbca-b8fe-4958-a51d-88e2cfa86ac4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.689706] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d18fcbca-b8fe-4958-a51d-88e2cfa86ac4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.689802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d18fcbca-b8fe-4958-a51d-88e2cfa86ac4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.689870] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d18fcbca-b8fe-4958-a51d-88e2cfa86ac4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.965529] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: SUCCESS [ 869.967017] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a deletion is rescheduled due to dependency. [ 869.967217] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.968108] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.968543] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.968836] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.969055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.969188] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.969525] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.969744] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.969926] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.070873] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-15d6f6bb-21e8-4682-a53e-1cc4b255699f taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.071764] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.071764] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.071764] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.071764] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.071764] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.072225] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.072225] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.072225] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.072225] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.072390] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-15d6f6bb-21e8-4682-a53e-1cc4b255699f taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.072441] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.072499] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.072702] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.072844] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.072991] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.072991] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.073125] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.073254] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.073345] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.073481] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.193117] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.193117] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.193117] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d18fcbca-b8fe-4958-a51d-88e2cfa86ac4 with status ACTIVE [ 870.193339] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.193339] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.193672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.193672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.193796] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.195035] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.195035] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.195035] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.195035] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.195035] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.195488] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.195621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.195685] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.195861] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.199988] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.199988] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d18fcbca-b8fe-4958-a51d-88e2cfa86ac4 is going to be updated. [ 870.225957] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.226968] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.226968] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.226968] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.226968] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.226968] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d18fcbca-b8fe-4958-a51d-88e2cfa86ac4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.473022] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.576596] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15d6f6bb-21e8-4682-a53e-1cc4b255699f: rpc.has_security_group_logging(os_id): False [ 870.605841] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.606114] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.606568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.606568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.606688] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.606852] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.606963] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.607046] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.607250] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.607315] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.608198] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.608198] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.608198] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.608198] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.608198] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.608481] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.608811] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.608811] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.608924] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.608924] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.609102] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f is going to be updated. [ 870.739057] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.739393] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.739520] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.740247] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.740247] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.757722] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f in Status: IN_PROGRESS for 2s [ 870.978660] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.124882] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ce997a4-e173-41da-a149-86945dba84fe in Status: SUCCESS [ 871.125258] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.365677] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 in Status: SUCCESS [ 871.366037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.481170] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.481398] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.481398] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.481635] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.481752] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.481828] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be updated. [ 871.518994] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.519652] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.519652] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.519652] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.519652] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.532218] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: IN_PROGRESS for 2s [ 871.988686] env[66834]: INFO networking_nsxv3.common.synchronization [None req-9f7ef54d-c830-4e6d-93b3-940a8a0b1b36 None None] Enqueued Resource ID: a8523a66-477e-4acf-892d-6baaf7b3b84c with Priority: HIGHEST for action port [ 871.991812] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8523a66-477e-4acf-892d-6baaf7b3b84c with Priority: HIGHEST for action port [ 871.991812] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8523a66-477e-4acf-892d-6baaf7b3b84c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.991812] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8523a66-477e-4acf-892d-6baaf7b3b84c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.991812] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8523a66-477e-4acf-892d-6baaf7b3b84c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.991812] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8523a66-477e-4acf-892d-6baaf7b3b84c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.991812] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8523a66-477e-4acf-892d-6baaf7b3b84c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.496811] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8523a66-477e-4acf-892d-6baaf7b3b84c [ 872.496811] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.496811] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.496811] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.496811] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.496811] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.496811] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8523a66-477e-4acf-892d-6baaf7b3b84c already deleted. [ 872.496811] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8523a66-477e-4acf-892d-6baaf7b3b84c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.770873] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f in Status: SUCCESS [ 872.771276] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.771477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.771833] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.771833] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.274043] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-15d6f6bb-21e8-4682-a53e-1cc4b255699f taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.274270] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.274353] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.274582] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.274801] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.274919] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.274995] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.275212] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.275293] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.275414] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.275509] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.546009] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: SUCCESS [ 873.546363] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.546590] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.546834] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.547116] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.547294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.547367] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.547536] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.548305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.548305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.548305] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.778872] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-15d6f6bb-21e8-4682-a53e-1cc4b255699f taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.779058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.779130] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.779348] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.779532] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.779630] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.779720] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.779898] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.779984] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.780083] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.780227] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-15d6f6bb-21e8-4682-a53e-1cc4b255699f taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.780314] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.780370] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.780503] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.780634] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.780718] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.780774] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.780902] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.780969] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.781082] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.781141] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.037663] env[66834]: INFO networking_nsxv3.common.synchronization [req-8020a0ce-4011-4865-b799-e7e8d61b302c req-24d170e9-70cd-4992-a218-3783452039a8 tempest-ImagesTestJSON-910661197 tempest-ImagesTestJSON-910661197-project-member] Enqueued Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 874.039654] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 874.039654] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.039654] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.039654] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.039654] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.039654] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.039654] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.039654] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.039654] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.040064] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.040064] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.050972] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.051663] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.051802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.052181] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.052384] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.052490] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.052551] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.052882] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.052882] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.053268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.053473] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.053580] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.053632] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.053806] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.053952] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.054648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.054832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.054874] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.055013] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.055039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.055131] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.220821] env[66834]: INFO networking_nsxv3.common.synchronization [None req-d253a390-3014-4ec2-a655-cc5cb05517ae None None] Enqueued Resource ID: 2154c690-625b-4030-a669-94b7f6840b79 with Priority: HIGHEST for action port [ 874.221407] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2154c690-625b-4030-a669-94b7f6840b79 with Priority: HIGHEST for action port [ 874.222089] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-2154c690-625b-4030-a669-94b7f6840b79 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.222227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2154c690-625b-4030-a669-94b7f6840b79" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.222293] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2154c690-625b-4030-a669-94b7f6840b79" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.222552] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2154c690-625b-4030-a669-94b7f6840b79" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.222639] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2154c690-625b-4030-a669-94b7f6840b79',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.283904] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15d6f6bb-21e8-4682-a53e-1cc4b255699f: rpc.has_security_group_logging(os_id): False [ 874.303307] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.303516] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.303582] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.303798] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.303896] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.304157] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.304261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.304326] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.305260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.305260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.305260] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.305260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.305260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.305260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.305260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.305519] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.305575] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.305600] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.305819] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.305819] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.306039] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f is going to be updated. [ 874.381419] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.381419] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.381419] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.381419] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.381419] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.396222] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f in Status: IN_PROGRESS for 2s [ 874.397094] env[66834]: INFO networking_nsxv3.common.synchronization [None req-e2a3442e-364f-4515-8214-3d3b01252ea8 None None] Enqueued Resource ID: 71207db7-a7e1-4612-87c3-35e1241644b4 with Priority: HIGHEST for action port [ 874.397617] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71207db7-a7e1-4612-87c3-35e1241644b4 with Priority: HIGHEST for action port [ 874.397894] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-71207db7-a7e1-4612-87c3-35e1241644b4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.398055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71207db7-a7e1-4612-87c3-35e1241644b4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.398171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71207db7-a7e1-4612-87c3-35e1241644b4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.398396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71207db7-a7e1-4612-87c3-35e1241644b4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.398475] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71207db7-a7e1-4612-87c3-35e1241644b4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.542398] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.557984] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a15c14c6-0aee-4e9d-b481-2661c510f44a: rpc.has_security_group_logging(os_id): False [ 874.576406] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.576596] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.576663] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.576855] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.576944] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.577166] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.577267] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.577330] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.577481] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.577558] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.577736] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.577825] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.577907] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.578045] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.578119] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.578313] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.578393] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.578455] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.578595] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.578669] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.578808] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be updated. [ 874.641328] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.641328] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.641328] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.641328] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.641328] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.659450] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: IN_PROGRESS for 2s [ 874.725709] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2154c690-625b-4030-a669-94b7f6840b79 [ 874.725917] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.726072] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.726129] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.726357] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.726437] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.726529] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2154c690-625b-4030-a669-94b7f6840b79 already deleted. [ 874.727214] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2154c690-625b-4030-a669-94b7f6840b79" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.729191] env[66834]: INFO networking_nsxv3.common.synchronization [None req-8a4b82a3-c66b-49c3-a998-fe917c052451 None None] Enqueued Resource ID: a5734cfc-5348-4270-b55c-0133a936409e with Priority: HIGHEST for action port [ 874.730716] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5734cfc-5348-4270-b55c-0133a936409e with Priority: HIGHEST for action port [ 874.731911] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5734cfc-5348-4270-b55c-0133a936409e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.731911] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5734cfc-5348-4270-b55c-0133a936409e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.731911] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5734cfc-5348-4270-b55c-0133a936409e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.731911] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5734cfc-5348-4270-b55c-0133a936409e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.731911] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5734cfc-5348-4270-b55c-0133a936409e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.902661] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71207db7-a7e1-4612-87c3-35e1241644b4 [ 874.902904] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.903044] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.903113] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.903327] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.903411] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.903500] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71207db7-a7e1-4612-87c3-35e1241644b4 already deleted. [ 874.903577] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71207db7-a7e1-4612-87c3-35e1241644b4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.046022] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.092240] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-793 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.092240] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-793" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.092240] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-793" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.092240] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-793" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.092456] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.092639] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.092750] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.094964] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.094964] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.094964] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 875.094964] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 875.094964] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 875.094964] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 875.094964] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 875.094964] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 875.094964] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 875.115928] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 875.116076] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 875.116237] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 875.116949] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-793" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.116949] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-b61e4ffe-7bde-4d0f-a31f-38982ad2ce5b taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.116949] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-b61e4ffe-7bde-4d0f-a31f-38982ad2ce5b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.116949] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-b61e4ffe-7bde-4d0f-a31f-38982ad2ce5b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.117284] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-b61e4ffe-7bde-4d0f-a31f-38982ad2ce5b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.117421] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b61e4ffe-7bde-4d0f-a31f-38982ad2ce5b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.235802] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a5734cfc-5348-4270-b55c-0133a936409e [ 875.236352] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.236352] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.236352] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.236486] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.236665] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.236665] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a5734cfc-5348-4270-b55c-0133a936409e already deleted. [ 875.236736] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5734cfc-5348-4270-b55c-0133a936409e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.553778] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.553778] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.553778] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.553778] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.553778] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.554636] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 is going to be updated. [ 875.592867] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.592867] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.592867] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.592867] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.592867] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.602963] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: IN_PROGRESS for 2s [ 875.621319] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.621319] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.621319] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.621319] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.621580] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.621656] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port b61e4ffe-7bde-4d0f-a31f-38982ad2ce5b not found, creating... [ 875.621950] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.622145] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.622455] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.622612] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.622748] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.623312] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.623560] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.624691] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.624691] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.624691] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.624691] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: b61e4ffe-7bde-4d0f-a31f-38982ad2ce5b is going to be created. [ 875.647622] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.648025] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.648025] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.648318] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.648542] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.648766] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-b61e4ffe-7bde-4d0f-a31f-38982ad2ce5b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.413589] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f in Status: SUCCESS [ 876.414083] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.547444] env[66834]: INFO networking_nsxv3.common.synchronization [req-8020a0ce-4011-4865-b799-e7e8d61b302c req-dc5dedde-4fa2-4a17-9746-5d3a725e359b service nova] Enqueued Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_rules [ 876.548189] env[66834]: INFO networking_nsxv3.common.synchronization [req-8020a0ce-4011-4865-b799-e7e8d61b302c req-dc5dedde-4fa2-4a17-9746-5d3a725e359b service nova] Enqueued Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 876.548441] env[66834]: INFO networking_nsxv3.common.synchronization [req-8020a0ce-4011-4865-b799-e7e8d61b302c req-dc5dedde-4fa2-4a17-9746-5d3a725e359b service nova] Enqueued Resource ID: b61e4ffe-7bde-4d0f-a31f-38982ad2ce5b with Priority: HIGHEST for action port [ 876.549174] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_rules [ 876.549445] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 876.552207] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b61e4ffe-7bde-4d0f-a31f-38982ad2ce5b with Priority: HIGHEST for action port [ 876.552207] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.552207] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.552207] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.552207] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.552207] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.552207] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.552207] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.552207] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-b61e4ffe-7bde-4d0f-a31f-38982ad2ce5b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.552207] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b61e4ffe-7bde-4d0f-a31f-38982ad2ce5b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.552207] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b61e4ffe-7bde-4d0f-a31f-38982ad2ce5b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.552207] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b61e4ffe-7bde-4d0f-a31f-38982ad2ce5b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.552207] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b61e4ffe-7bde-4d0f-a31f-38982ad2ce5b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.676615] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: SUCCESS [ 876.677038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.055158] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.055431] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.061150] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b61e4ffe-7bde-4d0f-a31f-38982ad2ce5b with status ACTIVE [ 877.061352] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.061473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.061577] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.061767] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.061877] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.062033] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.062158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.062265] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.062452] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.062541] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.062709] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.062802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.062909] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.062989] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.063074] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.063184] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b61e4ffe-7bde-4d0f-a31f-38982ad2ce5b is going to be updated. [ 877.089445] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.089445] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.089445] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.089774] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.089929] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.090476] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b61e4ffe-7bde-4d0f-a31f-38982ad2ce5b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.616626] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: SUCCESS [ 877.616626] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.616626] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.616626] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.616626] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.616626] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.616626] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.616626] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.616626] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.616626] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.699874] env[66834]: INFO networking_nsxv3.common.synchronization [None req-4b525d0b-1a04-4e62-908f-3d60fb5f16f3 tempest-AttachVolumeNegativeTest-457073585 tempest-AttachVolumeNegativeTest-457073585-project-member] Enqueued Resource ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 with Priority: HIGHEST for action security_group_rules [ 877.700832] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 with Priority: HIGHEST for action security_group_rules [ 877.701570] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ac1b684-ee07-41f3-926b-106a37b82e05 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.701833] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.703292] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.703292] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.703292] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ac1b684-ee07-41f3-926b-106a37b82e05',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.732916] env[66834]: INFO networking_nsxv3.common.synchronization [None req-5113e96f-d3d9-45c6-ad0a-1dbe77060a19 None None] Enqueued Resource ID: 44b2c1b6-da69-4829-878e-b56e0fc7c4bc with Priority: HIGHEST for action port [ 877.732916] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b2c1b6-da69-4829-878e-b56e0fc7c4bc with Priority: HIGHEST for action port [ 877.732916] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-44b2c1b6-da69-4829-878e-b56e0fc7c4bc taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.732916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44b2c1b6-da69-4829-878e-b56e0fc7c4bc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.732916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44b2c1b6-da69-4829-878e-b56e0fc7c4bc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.732916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44b2c1b6-da69-4829-878e-b56e0fc7c4bc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.732916] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44b2c1b6-da69-4829-878e-b56e0fc7c4bc',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.834602] env[66834]: INFO networking_nsxv3.common.synchronization [None req-ee2f3b25-c6f2-4426-ab6b-992124c995fc tempest-AttachVolumeNegativeTest-457073585 tempest-AttachVolumeNegativeTest-457073585-project-member] Enqueued Resource ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 with Priority: HIGHEST for action security_group_rules [ 877.836378] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 with Priority: HIGHEST for action security_group_rules [ 877.836378] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ac1b684-ee07-41f3-926b-106a37b82e05 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.836378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.122840] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.224536] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.224685] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.224736] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.224944] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.225051] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.225145] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 already deleted. [ 878.225234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.225433] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.225611] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.225611] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ac1b684-ee07-41f3-926b-106a37b82e05',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.238919] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44b2c1b6-da69-4829-878e-b56e0fc7c4bc [ 878.239182] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.239619] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.239619] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.239619] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.239800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.239800] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44b2c1b6-da69-4829-878e-b56e0fc7c4bc already deleted. [ 878.239922] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44b2c1b6-da69-4829-878e-b56e0fc7c4bc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.311402] env[66834]: INFO networking_nsxv3.common.synchronization [None req-d4e63eef-1169-4c72-8cf6-b1bf5716a4cd None None] Enqueued Resource ID: 6f5cae69-3ea1-4867-8caf-7555a4101c6c with Priority: HIGHEST for action port [ 878.312388] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f5cae69-3ea1-4867-8caf-7555a4101c6c with Priority: HIGHEST for action port [ 878.312722] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f5cae69-3ea1-4867-8caf-7555a4101c6c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.312835] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f5cae69-3ea1-4867-8caf-7555a4101c6c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.312917] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f5cae69-3ea1-4867-8caf-7555a4101c6c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.313298] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f5cae69-3ea1-4867-8caf-7555a4101c6c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.313620] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f5cae69-3ea1-4867-8caf-7555a4101c6c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.623082] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.751303] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.751694] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.751694] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.751831] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.751883] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.751959] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 already deleted. [ 878.752056] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.815500] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6f5cae69-3ea1-4867-8caf-7555a4101c6c [ 878.815800] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.816263] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.816383] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.816715] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.816881] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.817010] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6f5cae69-3ea1-4867-8caf-7555a4101c6c already deleted. [ 878.817153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f5cae69-3ea1-4867-8caf-7555a4101c6c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.132182] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.132182] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.132182] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.132182] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.132182] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.132182] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 is going to be updated. [ 879.167888] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.168070] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.168148] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.169208] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.169208] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.178967] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: IN_PROGRESS for 2s [ 881.146273] env[66834]: INFO networking_nsxv3.common.synchronization [None req-f7aaba1a-52f9-4d91-9a4b-d5a6465ddea6 tempest-AttachInterfacesTestJSON-77868371 tempest-AttachInterfacesTestJSON-77868371-project-member] Enqueued Resource ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 with Priority: HIGHEST for action security_group_rules [ 881.146865] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 with Priority: HIGHEST for action security_group_rules [ 881.150540] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-074f3129-4b43-4c6a-91e1-f738692c4d34 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.150685] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.150787] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.151253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.151349] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('074f3129-4b43-4c6a-91e1-f738692c4d34',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.193472] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: SUCCESS [ 881.193883] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.195897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.195897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.195897] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.195897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.195897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.195897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.195897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.195897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.195897] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.264368] env[66834]: INFO networking_nsxv3.common.synchronization [None req-d17eee0d-dbcd-4181-9c78-0d67076c9c5a tempest-AttachInterfacesTestJSON-77868371 tempest-AttachInterfacesTestJSON-77868371-project-member] Enqueued Resource ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 with Priority: HIGHEST for action security_group_rules [ 881.264462] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 with Priority: HIGHEST for action security_group_rules [ 881.264936] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-074f3129-4b43-4c6a-91e1-f738692c4d34 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.265026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.678086] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.678403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.678500] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.678725] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.678818] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.678918] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 already deleted. [ 881.679023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.679183] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.679365] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.679456] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('074f3129-4b43-4c6a-91e1-f738692c4d34',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.699077] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.699265] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.699335] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.699556] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.699733] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.699923] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.699989] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.700166] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.700251] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.700340] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.700533] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.700672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.700789] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.700965] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.701125] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.701234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.701293] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.702103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.702103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.702103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.702103] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.900488] env[66834]: INFO networking_nsxv3.common.synchronization [req-58b724b7-203e-4811-989c-4f24c5e5b3a6 req-1ffa529b-70fe-43af-a382-f79ba42a794f tempest-ListServersNegativeTestJSON-1125916362 tempest-ListServersNegativeTestJSON-1125916362-project-member] Enqueued Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGHEST for action security_group_members [ 881.901154] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGHEST for action security_group_members [ 881.903906] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-15d6f6bb-21e8-4682-a53e-1cc4b255699f taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.904039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.904128] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.904315] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.904481] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.904603] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.904667] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.904777] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.904879] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.904975] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.207035] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 599d582a-c0d7-4df7-a1fe-3e63412d8939: rpc.has_security_group_logging(os_id): False [ 882.213406] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.213406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.213406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.213406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.213406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.213406] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 already deleted. [ 882.213406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.226229] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.226229] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.228344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.228344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.228344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.228344] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.228344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.228344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.228344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.228344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.228344] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.228344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.228344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.228344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.228344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.228344] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.228853] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.228853] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.228853] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.228853] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.228853] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 is going to be updated. [ 882.297028] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.297028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.297028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.297028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.297028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.314043] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: IN_PROGRESS for 2s [ 882.411296] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.916263] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.420116] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.420588] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.420588] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.420588] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.421029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.421029] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f is going to be updated. [ 883.456057] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.456221] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.456290] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.456539] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.456854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.474999] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f in Status: IN_PROGRESS for 2s [ 884.342517] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: SUCCESS [ 884.342517] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.427176] env[66834]: INFO networking_nsxv3.common.synchronization [req-e0308172-afb9-4e5a-8292-3ca35aa20639 req-1311efa9-69b8-49c7-b365-d5342f506dcd tempest-ServersTestJSON-861266990 tempest-ServersTestJSON-861266990-project-member] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 885.428821] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 885.429568] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.429568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.429568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.430339] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.430699] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.432796] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.432796] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.432796] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.432796] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.432796] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.491375] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f in Status: SUCCESS [ 885.491639] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.905525] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-849 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.906164] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.906427] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.906779] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.907209] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.907344] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.907495] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.907770] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.907928] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.908164] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 885.908279] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.908388] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.908490] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.908597] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 885.908857] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.908857] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.934636] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.934636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.934636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.934636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.934636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.934636] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.934636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.934636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.934920] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.934920] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.934920] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 already deleted. [ 885.934994] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.936246] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.936419] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 885.936552] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.937404] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.937404] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-70788332-315c-4939-b191-dbdccaaeafc5 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.937404] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-70788332-315c-4939-b191-dbdccaaeafc5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.937404] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-70788332-315c-4939-b191-dbdccaaeafc5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.937632] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-70788332-315c-4939-b191-dbdccaaeafc5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.937681] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70788332-315c-4939-b191-dbdccaaeafc5',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.441972] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.442301] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.442387] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.442672] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.442854] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.442992] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 70788332-315c-4939-b191-dbdccaaeafc5 not found, creating... [ 886.443287] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.443465] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.443594] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.443830] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.443962] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.444322] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.444495] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.444612] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.444814] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.444946] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.445096] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 70788332-315c-4939-b191-dbdccaaeafc5 is going to be created. [ 886.483032] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.483316] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.483448] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.483988] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.484332] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.484763] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-70788332-315c-4939-b191-dbdccaaeafc5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.692836] env[66834]: INFO networking_nsxv3.common.synchronization [req-e2110019-f7e6-4135-b159-8e67d83c0090 req-d660b3bb-28da-446f-9228-e6b9d1a920c0 tempest-ListServerFiltersTestJSON-1401422689 tempest-ListServerFiltersTestJSON-1401422689-project-member] Enqueued Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGHEST for action security_group_members [ 886.694560] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGHEST for action security_group_members [ 886.694777] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.694949] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.695076] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.695397] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.695678] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.695834] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.695930] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.696222] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.696362] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.696529] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.200444] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.200652] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.201832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.201832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.201832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.201832] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.201832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.201832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.201832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.201832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.201832] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ce997a4-e173-41da-a149-86945dba84fe is going to be updated. [ 887.232448] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.232592] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.232867] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.233023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.233191] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.244581] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ce997a4-e173-41da-a149-86945dba84fe in Status: IN_PROGRESS for 2s [ 887.294615] env[66834]: INFO networking_nsxv3.common.synchronization [req-e0308172-afb9-4e5a-8292-3ca35aa20639 req-128aba60-1615-4f0a-acb3-ba455c6f572b service nova] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_rules [ 887.294786] env[66834]: INFO networking_nsxv3.common.synchronization [req-e0308172-afb9-4e5a-8292-3ca35aa20639 req-128aba60-1615-4f0a-acb3-ba455c6f572b service nova] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 887.294924] env[66834]: INFO networking_nsxv3.common.synchronization [req-e0308172-afb9-4e5a-8292-3ca35aa20639 req-128aba60-1615-4f0a-acb3-ba455c6f572b service nova] Enqueued Resource ID: 70788332-315c-4939-b191-dbdccaaeafc5 with Priority: HIGHEST for action port [ 887.295515] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_rules [ 887.295888] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 887.295980] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70788332-315c-4939-b191-dbdccaaeafc5 with Priority: HIGHEST for action port [ 887.296305] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.296412] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.296478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.296725] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.296810] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.297665] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.297834] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.297834] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.298033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.298167] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.298262] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.298323] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.298472] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.298557] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.298645] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.301599] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-70788332-315c-4939-b191-dbdccaaeafc5 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.301599] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70788332-315c-4939-b191-dbdccaaeafc5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.301794] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70788332-315c-4939-b191-dbdccaaeafc5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.301794] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70788332-315c-4939-b191-dbdccaaeafc5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.301883] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70788332-315c-4939-b191-dbdccaaeafc5',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.803539] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.805583] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.805583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.805812] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70788332-315c-4939-b191-dbdccaaeafc5 with status ACTIVE [ 887.805928] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.806191] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.806269] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.806567] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.806676] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.806884] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.807019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.807444] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.807444] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.807444] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.807526] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.807617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.807783] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.808016] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.808181] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.808181] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70788332-315c-4939-b191-dbdccaaeafc5 is going to be updated. [ 887.845746] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.845746] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.845746] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.845746] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.845746] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.845746] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70788332-315c-4939-b191-dbdccaaeafc5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.216823] env[66834]: INFO networking_nsxv3.common.synchronization [req-3e578561-6e25-474f-aad3-b437e66a44e5 req-ed506fd2-6692-4a14-a751-1f3b18735079 tempest-ServersNegativeTestJSON-499609681 tempest-ServersNegativeTestJSON-499609681-project-member] Enqueued Resource ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c with Priority: HIGHEST for action security_group_members [ 888.217332] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c with Priority: HIGHEST for action security_group_members [ 888.218158] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.218158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.218158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.218405] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.218595] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.218754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.218754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.219554] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.219554] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.220157] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.307739] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.722541] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.722707] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.722794] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.723461] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.723461] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.723660] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.723743] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.723743] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.723955] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.724053] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.724180] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c already deleted. [ 888.724286] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.809329] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.809610] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.809610] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.809886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.810022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.810129] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be created. [ 888.842043] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.842043] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.842043] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.842043] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.842043] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.858219] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: UNINITIALIZED for 2s [ 888.920582] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-615 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.920848] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-615" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.920968] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-615" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.921517] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-615" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.921801] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.921968] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.922457] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.922735] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.922900] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.923193] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 888.923438] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 888.923584] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 888.923743] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 888.923864] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 888.924032] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 888.924135] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 888.950362] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 888.950543] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 888.950686] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 888.950891] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-615" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.951401] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.951626] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.951721] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.952233] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.952402] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.261064] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ce997a4-e173-41da-a149-86945dba84fe in Status: SUCCESS [ 889.261339] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ce997a4-e173-41da-a149-86945dba84fe deletion is rescheduled due to dependency. [ 889.261412] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.454898] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.455163] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.455290] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.455629] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.455827] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.455952] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3 not found, creating... [ 889.456257] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.456421] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.456575] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.456793] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.457220] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.457357] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.457549] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.457642] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.457900] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.458758] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.458936] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3 is going to be created. [ 889.491756] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.491756] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.491756] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.491756] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.491756] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.491756] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.839127] env[66834]: INFO networking_nsxv3.common.synchronization [None req-cf5f0663-c0dd-45a8-9f75-f328191efb8f None None] Enqueued Resource ID: 8419b552-a2cb-4e2a-a0e1-3da5119c9d0e with Priority: HIGHEST for action port [ 889.839724] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8419b552-a2cb-4e2a-a0e1-3da5119c9d0e with Priority: HIGHEST for action port [ 889.840124] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-8419b552-a2cb-4e2a-a0e1-3da5119c9d0e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.840334] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8419b552-a2cb-4e2a-a0e1-3da5119c9d0e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.840440] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8419b552-a2cb-4e2a-a0e1-3da5119c9d0e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.844021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8419b552-a2cb-4e2a-a0e1-3da5119c9d0e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.844021] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8419b552-a2cb-4e2a-a0e1-3da5119c9d0e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.261729] env[66834]: INFO networking_nsxv3.common.synchronization [req-3e578561-6e25-474f-aad3-b437e66a44e5 req-146d3049-bdff-42f1-aea6-2caca9db605e service nova] Enqueued Resource ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c with Priority: HIGHEST for action security_group_rules [ 890.261729] env[66834]: INFO networking_nsxv3.common.synchronization [req-3e578561-6e25-474f-aad3-b437e66a44e5 req-146d3049-bdff-42f1-aea6-2caca9db605e service nova] Enqueued Resource ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c with Priority: HIGHEST for action security_group_members [ 890.262261] env[66834]: INFO networking_nsxv3.common.synchronization [req-3e578561-6e25-474f-aad3-b437e66a44e5 req-146d3049-bdff-42f1-aea6-2caca9db605e service nova] Enqueued Resource ID: a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3 with Priority: HIGHEST for action port [ 890.262912] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c with Priority: HIGHEST for action security_group_rules [ 890.262912] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c with Priority: HIGHEST for action security_group_members [ 890.262912] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3 with Priority: HIGHEST for action port [ 890.262912] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.263281] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.263281] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.263336] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.263378] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.264875] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.265820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.265820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.265820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.265820] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.265820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.265820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.265820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.266228] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.266228] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.266918] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.268078] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.268078] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.268078] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.268078] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.344245] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8419b552-a2cb-4e2a-a0e1-3da5119c9d0e [ 890.344245] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.344502] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.344502] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.344689] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.344825] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.345161] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8419b552-a2cb-4e2a-a0e1-3da5119c9d0e already deleted. [ 890.345161] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8419b552-a2cb-4e2a-a0e1-3da5119c9d0e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.767025] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.767025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.773029] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.773029] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3 with status ACTIVE [ 890.773029] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.773029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.773029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.773029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.773029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.773029] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.773029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.773917] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.774283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.774485] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.774780] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.775119] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.775298] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.775532] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.775771] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.775964] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3 is going to be updated. [ 890.807683] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.807683] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.807683] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.807945] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.808139] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.808348] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.858411] env[66834]: INFO networking_nsxv3.common.synchronization [req-9ac84787-556c-4ea9-a3c1-91beaa905fa7 req-f1bfa91a-6dea-468e-88ca-4fafb159c534 tempest-MultipleCreateTestJSON-60451393 tempest-MultipleCreateTestJSON-60451393-project-member] Enqueued Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_members [ 890.859764] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_members [ 890.862100] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.862348] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.862477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.862768] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.863181] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.864126] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.864244] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.864459] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.864597] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.864972] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.877601] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 890.878503] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.878745] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.879015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.879651] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.879859] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.880597] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.880867] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.881029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.881179] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.881517] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.280027] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.372596] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.372734] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.372854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.373060] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.373153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.373356] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.373451] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.373511] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.373667] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.373735] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.373814] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 already deleted. [ 891.373890] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.385426] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.385587] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.385707] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.386020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.386111] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.386270] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.386303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.386443] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.386526] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.386618] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.386762] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.389184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.389184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.389184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.389184] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.389184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.389184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.389184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.389184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.389184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.389184] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.779714] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-413 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.780331] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-413" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.780523] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-413" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.781015] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-413" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.781430] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.781676] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.781862] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.782202] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.783054] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.783054] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 891.783054] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 891.783054] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 891.783225] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 891.783390] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 891.783556] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 891.783757] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 891.785791] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.785961] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.786069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.786301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.786449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.786576] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c is going to be created. [ 891.814274] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 891.814905] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 891.814905] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 891.815108] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-413" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.815495] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-a8ef8f76-a92f-421a-aa11-92eb86de3cc0 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.815723] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-a8ef8f76-a92f-421a-aa11-92eb86de3cc0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.815855] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-a8ef8f76-a92f-421a-aa11-92eb86de3cc0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.816293] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-a8ef8f76-a92f-421a-aa11-92eb86de3cc0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.816491] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8ef8f76-a92f-421a-aa11-92eb86de3cc0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.818654] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.818805] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.818869] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.819218] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.819400] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.838297] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c in Status: UNINITIALIZED for 2s [ 891.897405] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c88662f-4694-4988-b716-56b85d22f3c9: rpc.has_security_group_logging(os_id): False [ 891.934720] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.934861] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.934925] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.935178] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.935279] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.935479] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.935579] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.935652] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.935802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.935878] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.936286] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.936286] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.936286] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.936485] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.936485] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.936600] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.936693] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.936744] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.936877] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.936949] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.939934] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be created. [ 892.009308] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.009308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.009308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.009308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.009308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.025519] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 892.209546] env[66834]: INFO networking_nsxv3.common.synchronization [None req-6d0e3969-b476-404b-b2e2-809e7b417108 None None] Enqueued Resource ID: 6f954ec0-f090-43c0-b0ac-8d8bdad974b7 with Priority: HIGHEST for action port [ 892.210309] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f954ec0-f090-43c0-b0ac-8d8bdad974b7 with Priority: HIGHEST for action port [ 892.210654] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f954ec0-f090-43c0-b0ac-8d8bdad974b7 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.210988] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f954ec0-f090-43c0-b0ac-8d8bdad974b7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.210988] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f954ec0-f090-43c0-b0ac-8d8bdad974b7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.211275] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f954ec0-f090-43c0-b0ac-8d8bdad974b7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.211275] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f954ec0-f090-43c0-b0ac-8d8bdad974b7',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.321919] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.322295] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.322295] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.322543] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.322756] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.323033] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port a8ef8f76-a92f-421a-aa11-92eb86de3cc0 not found, creating... [ 892.323305] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.323464] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.323581] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.323808] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.323951] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.324288] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.324531] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.324656] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.324867] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.325025] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.325174] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: a8ef8f76-a92f-421a-aa11-92eb86de3cc0 is going to be created. [ 892.348978] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.349271] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.349395] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.349669] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.350078] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.350266] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-a8ef8f76-a92f-421a-aa11-92eb86de3cc0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.713964] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6f954ec0-f090-43c0-b0ac-8d8bdad974b7 [ 892.714145] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.714310] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.714382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.714603] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.714695] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.714877] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6f954ec0-f090-43c0-b0ac-8d8bdad974b7 already deleted. [ 892.714877] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f954ec0-f090-43c0-b0ac-8d8bdad974b7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.130543] env[66834]: INFO networking_nsxv3.common.synchronization [req-9ac84787-556c-4ea9-a3c1-91beaa905fa7 req-3e8746d2-02b8-4e84-ad57-99f6639e467a service nova] Enqueued Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_rules [ 893.130762] env[66834]: INFO networking_nsxv3.common.synchronization [req-9ac84787-556c-4ea9-a3c1-91beaa905fa7 req-3e8746d2-02b8-4e84-ad57-99f6639e467a service nova] Enqueued Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_members [ 893.130792] env[66834]: INFO networking_nsxv3.common.synchronization [req-9ac84787-556c-4ea9-a3c1-91beaa905fa7 req-3e8746d2-02b8-4e84-ad57-99f6639e467a service nova] Enqueued Resource ID: a8ef8f76-a92f-421a-aa11-92eb86de3cc0 with Priority: HIGHEST for action port [ 893.135339] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_rules [ 893.135579] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_members [ 893.135757] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8ef8f76-a92f-421a-aa11-92eb86de3cc0 with Priority: HIGHEST for action port [ 893.137453] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49d65b4d-9206-4925-b862-2ad0f3d9eaf1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.137453] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.137453] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.137710] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.137834] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.138844] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.139309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.139309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.139309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.139309] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.139449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.142304] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.142621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.142772] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.142948] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.144599] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8ef8f76-a92f-421a-aa11-92eb86de3cc0 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.144847] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8ef8f76-a92f-421a-aa11-92eb86de3cc0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.144911] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8ef8f76-a92f-421a-aa11-92eb86de3cc0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.145140] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8ef8f76-a92f-421a-aa11-92eb86de3cc0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.145470] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8ef8f76-a92f-421a-aa11-92eb86de3cc0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.479463] env[66834]: INFO networking_nsxv3.common.synchronization [req-9ac84787-556c-4ea9-a3c1-91beaa905fa7 req-c677a554-8c3a-45db-b1e3-c094c0adbe02 tempest-MultipleCreateTestJSON-60451393 tempest-MultipleCreateTestJSON-60451393-project-member] Enqueued Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_members [ 893.481113] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_members [ 893.481113] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.481113] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.648357] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.648485] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.648752] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.650687] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8ef8f76-a92f-421a-aa11-92eb86de3cc0 with status ACTIVE [ 893.650687] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.650687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.650687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.650687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.650687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.650687] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.650687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.650687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.651152] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.651152] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.652600] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.652870] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.652956] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.653194] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.653228] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.653298] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8ef8f76-a92f-421a-aa11-92eb86de3cc0 is going to be updated. [ 893.679270] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.679505] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.679505] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.680233] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.680233] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.680233] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8ef8f76-a92f-421a-aa11-92eb86de3cc0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.810253] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-413 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.810437] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-413" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.810583] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-413" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.810859] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-413" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.811248] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.811422] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.811541] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.811771] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.811917] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.812138] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 893.812252] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 893.812358] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 893.812464] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 893.812588] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 893.812678] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 893.812807] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 893.835436] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 893.835600] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 893.835735] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 893.835910] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-413" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.836323] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-ccb120bf-1071-4c8d-96fd-f018260dbd34 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.836562] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-ccb120bf-1071-4c8d-96fd-f018260dbd34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.836717] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-ccb120bf-1071-4c8d-96fd-f018260dbd34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.837149] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-ccb120bf-1071-4c8d-96fd-f018260dbd34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.837334] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccb120bf-1071-4c8d-96fd-f018260dbd34',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.859221] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c in Status: SUCCESS [ 893.859438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.859613] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.859956] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.860182] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.860304] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.860365] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.860524] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.860604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.860687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.860773] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.043073] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 894.043273] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.155353] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.345702] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.346029] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.346167] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.346520] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.346713] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.346984] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port ccb120bf-1071-4c8d-96fd-f018260dbd34 not found, creating... [ 894.347521] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.347719] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.347880] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.348351] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.348420] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.348710] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.348865] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.349041] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.349313] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.349446] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.349618] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: ccb120bf-1071-4c8d-96fd-f018260dbd34 is going to be created. [ 894.365942] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.365942] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.365942] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.365942] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.366320] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.366320] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.366320] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.367087] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.367087] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.367087] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.367087] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.367087] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.367087] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.367339] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.367339] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.367339] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.367452] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.367510] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.367580] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.367656] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.367789] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.379636] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.380524] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.380659] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.380909] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.381321] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.381468] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-ccb120bf-1071-4c8d-96fd-f018260dbd34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.658251] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.658442] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.658522] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.658742] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.658840] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.658940] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 is going to be created. [ 894.690132] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.690565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.690565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.690698] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.690770] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.702454] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: UNINITIALIZED for 2s [ 894.872420] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c: rpc.has_security_group_logging(os_id): False [ 894.895315] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.895315] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.895315] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.895315] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.895315] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.895315] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.895624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.895624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.895624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.895624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.895833] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.895951] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.896028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.896186] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.896260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.896438] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.896530] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.896591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.896727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.896799] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.896912] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c is going to be created. [ 894.964000] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.964122] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.964158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.964361] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.964527] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.978116] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c in Status: IN_PROGRESS for 2s [ 895.153050] env[66834]: INFO networking_nsxv3.common.synchronization [req-9ac84787-556c-4ea9-a3c1-91beaa905fa7 req-c1807f57-f232-48a8-a3d6-f2d84cb4ff8f service nova] Enqueued Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_rules [ 895.153467] env[66834]: INFO networking_nsxv3.common.synchronization [req-9ac84787-556c-4ea9-a3c1-91beaa905fa7 req-c1807f57-f232-48a8-a3d6-f2d84cb4ff8f service nova] Enqueued Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_members [ 895.153608] env[66834]: INFO networking_nsxv3.common.synchronization [req-9ac84787-556c-4ea9-a3c1-91beaa905fa7 req-c1807f57-f232-48a8-a3d6-f2d84cb4ff8f service nova] Enqueued Resource ID: ccb120bf-1071-4c8d-96fd-f018260dbd34 with Priority: HIGHEST for action port [ 895.154225] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_rules [ 895.154471] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_members [ 895.154471] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccb120bf-1071-4c8d-96fd-f018260dbd34 with Priority: HIGHEST for action port [ 895.155058] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49d65b4d-9206-4925-b862-2ad0f3d9eaf1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.155058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.155058] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.155239] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.155360] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-ccb120bf-1071-4c8d-96fd-f018260dbd34 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.155541] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ccb120bf-1071-4c8d-96fd-f018260dbd34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.155541] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ccb120bf-1071-4c8d-96fd-f018260dbd34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.155887] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ccb120bf-1071-4c8d-96fd-f018260dbd34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.155887] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccb120bf-1071-4c8d-96fd-f018260dbd34',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.659152] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ccb120bf-1071-4c8d-96fd-f018260dbd34 with status ACTIVE [ 895.659152] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.659152] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.659152] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.659351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.659450] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.660629] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.660629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.660629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.660629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.660629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.660629] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.660629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.661435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.661750] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.661880] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.662783] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ccb120bf-1071-4c8d-96fd-f018260dbd34 is going to be updated. [ 895.689830] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.690049] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.690144] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.690330] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.690470] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.690648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ccb120bf-1071-4c8d-96fd-f018260dbd34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.725292] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: SUCCESS [ 896.725834] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.725834] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.726620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.726620] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.726620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.726620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.726844] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.726844] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.726905] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.994162] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c in Status: SUCCESS [ 896.994580] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.103450] env[66834]: INFO networking_nsxv3.common.synchronization [req-d8fdebb3-07d7-4a30-9200-a7ad26e7589a req-a69039ed-1681-42db-9955-111b265da967 tempest-ImagesTestJSON-910661197 tempest-ImagesTestJSON-910661197-project-member] Enqueued Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 897.104190] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 897.104810] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.104810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.104810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.105134] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.105355] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.105510] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.105591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.108986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.108986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.108986] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.232172] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.608987] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.733917] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.045250] env[66834]: INFO networking_nsxv3.common.synchronization [req-d171a973-6976-4040-8844-f5c9a7bc5054 req-1f211808-b3ae-4361-99b3-2c0e05cfd233 tempest-MigrationsAdminTest-1673437967 tempest-MigrationsAdminTest-1673437967-project-member] Enqueued Resource ID: f46326b4-7843-4c05-8eca-cb73edd99c30 with Priority: HIGHEST for action security_group_members [ 898.045819] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f46326b4-7843-4c05-8eca-cb73edd99c30 with Priority: HIGHEST for action security_group_members [ 898.046163] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-f46326b4-7843-4c05-8eca-cb73edd99c30 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.046319] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.046392] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.046600] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.046786] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.046892] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.046971] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.051179] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.051231] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.051593] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f46326b4-7843-4c05-8eca-cb73edd99c30',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.111776] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.238903] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.238903] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.238903] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.238903] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.238903] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.238903] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 is going to be updated. [ 898.293017] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.293234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.294213] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.294213] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.294213] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.306073] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: IN_PROGRESS for 2s [ 898.497286] env[66834]: INFO networking_nsxv3.common.synchronization [req-482ef255-90a3-4951-9d53-647d82ada34b req-b64ae7c1-6274-4755-b39e-66a319d3fe70 tempest-ListImageFiltersTestJSON-1653843489 tempest-ListImageFiltersTestJSON-1653843489-project-member] Enqueued Resource ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd with Priority: HIGHEST for action security_group_members [ 898.498021] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd with Priority: HIGHEST for action security_group_members [ 898.498345] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.498719] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.498799] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.498980] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.499345] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.499345] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.499345] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.499524] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.499649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.499698] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e7c2a7-894d-4c35-9c95-4f7fee507dfd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.553370] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f46326b4-7843-4c05-8eca-cb73edd99c30',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.615241] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.615414] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.615467] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.615744] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.615901] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.615990] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 is going to be updated. [ 898.653730] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.654469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.654469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.654469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.654608] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.666599] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: IN_PROGRESS for 2s [ 898.754801] env[66834]: INFO networking_nsxv3.common.synchronization [None req-88053d7d-8e0f-44c7-a34b-a10db59d9e8a None None] Enqueued Resource ID: 10a4e28a-2faa-43c3-abc4-c6f284a7f46d with Priority: HIGHEST for action port [ 898.754801] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10a4e28a-2faa-43c3-abc4-c6f284a7f46d with Priority: HIGHEST for action port [ 898.754801] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-10a4e28a-2faa-43c3-abc4-c6f284a7f46d taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.755335] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10a4e28a-2faa-43c3-abc4-c6f284a7f46d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.755335] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10a4e28a-2faa-43c3-abc4-c6f284a7f46d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.755335] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10a4e28a-2faa-43c3-abc4-c6f284a7f46d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.755335] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10a4e28a-2faa-43c3-abc4-c6f284a7f46d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.002069] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68e7c2a7-894d-4c35-9c95-4f7fee507dfd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.057200] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f46326b4-7843-4c05-8eca-cb73edd99c30',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.258911] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 10a4e28a-2faa-43c3-abc4-c6f284a7f46d [ 899.259210] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.259358] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.259468] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.259664] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.259732] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.260543] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:10a4e28a-2faa-43c3-abc4-c6f284a7f46d already deleted. [ 899.260543] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10a4e28a-2faa-43c3-abc4-c6f284a7f46d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.506051] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68e7c2a7-894d-4c35-9c95-4f7fee507dfd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.562560] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.562716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.562777] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.562985] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.563093] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.563203] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f46326b4-7843-4c05-8eca-cb73edd99c30 is going to be updated. [ 899.592890] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.593060] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.593124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.593331] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.593477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.604036] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f46326b4-7843-4c05-8eca-cb73edd99c30 in Status: IN_PROGRESS for 2s [ 900.009050] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.009544] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.009544] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.009544] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.009650] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.009771] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd is going to be updated. [ 900.045382] env[66834]: INFO networking_nsxv3.common.synchronization [None req-4c71fd9c-4d6c-4cd5-b4b4-b9861fb5d2d3 tempest-ServersTestBootFromVolume-1337405367 tempest-ServersTestBootFromVolume-1337405367-project-member] Enqueued Resource ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 with Priority: HIGHEST for action security_group_rules [ 900.046555] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.046725] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.046778] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.047148] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.047219] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.048548] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 with Priority: HIGHEST for action security_group_rules [ 900.048882] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c5efb50-1e08-43fc-a6ab-e2d1db110262 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.049018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.049088] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.049335] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.049442] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c5efb50-1e08-43fc-a6ab-e2d1db110262',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.062679] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd in Status: IN_PROGRESS for 2s [ 900.202270] env[66834]: INFO networking_nsxv3.common.synchronization [None req-f7ebe74a-6893-4b4e-ae07-9836bc69fc46 tempest-ServersTestBootFromVolume-1337405367 tempest-ServersTestBootFromVolume-1337405367-project-member] Enqueued Resource ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 with Priority: HIGHEST for action security_group_rules [ 900.202270] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 with Priority: HIGHEST for action security_group_rules [ 900.202351] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c5efb50-1e08-43fc-a6ab-e2d1db110262 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.202467] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.319592] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: SUCCESS [ 900.319876] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.320199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.320545] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.320766] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.320939] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.321025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.321323] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.321484] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.321651] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.322178] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.326011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.326011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.326011] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.326011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.326011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.326011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.326011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.326011] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.575874] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.575874] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.575874] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.575874] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.575874] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.575874] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 already deleted. [ 900.575874] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.575874] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.576365] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.576365] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c5efb50-1e08-43fc-a6ab-e2d1db110262',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.677218] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: SUCCESS [ 900.677381] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.827984] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.828124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.828349] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.100866] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.102169] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.102169] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.102169] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.102169] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.102169] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 already deleted. [ 901.103327] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.331909] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.615899] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f46326b4-7843-4c05-8eca-cb73edd99c30 in Status: SUCCESS [ 901.618355] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.837505] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.837789] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.837789] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.838261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.838261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.838427] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 is going to be updated. [ 901.896934] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.897226] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.897326] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.897644] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.897886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.922450] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: IN_PROGRESS for 2s [ 902.074939] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd in Status: SUCCESS [ 902.075103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.996408] env[66834]: INFO networking_nsxv3.common.synchronization [None req-b37032a5-c7d5-482d-ab86-a975c679c134 None None] Enqueued Resource ID: 9839c946-5029-4fa3-a6e3-dc6b7b35c249 with Priority: HIGHEST for action port [ 902.996408] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9839c946-5029-4fa3-a6e3-dc6b7b35c249 with Priority: HIGHEST for action port [ 902.996763] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-9839c946-5029-4fa3-a6e3-dc6b7b35c249 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.996763] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9839c946-5029-4fa3-a6e3-dc6b7b35c249" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.996763] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9839c946-5029-4fa3-a6e3-dc6b7b35c249" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.997237] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9839c946-5029-4fa3-a6e3-dc6b7b35c249" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.997372] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9839c946-5029-4fa3-a6e3-dc6b7b35c249',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.498997] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9839c946-5029-4fa3-a6e3-dc6b7b35c249 [ 903.499266] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.501288] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.501369] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.501664] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.501773] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.501882] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9839c946-5029-4fa3-a6e3-dc6b7b35c249 already deleted. [ 903.501981] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9839c946-5029-4fa3-a6e3-dc6b7b35c249" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.764493] env[66834]: INFO networking_nsxv3.common.synchronization [req-6ca53b9a-a8f3-48ec-be77-963d4ca3bb2b req-f4a16592-c57b-4b84-837c-53a1f14e213b tempest-AttachVolumeNegativeTest-457073585 tempest-AttachVolumeNegativeTest-457073585-project-member] Enqueued Resource ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 with Priority: HIGHEST for action security_group_members [ 903.764493] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 with Priority: HIGHEST for action security_group_members [ 903.765161] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ac1b684-ee07-41f3-926b-106a37b82e05 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.765161] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.765161] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.765161] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.765565] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.765565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.765565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.765699] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.765811] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.765811] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ac1b684-ee07-41f3-926b-106a37b82e05',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.933992] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: SUCCESS [ 903.934309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.934494] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.934741] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.934951] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.935137] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.935216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.935660] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.935660] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.935660] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.935806] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.935860] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.935901] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.937666] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.937666] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.937666] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.937666] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.937666] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.937666] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.937666] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.937666] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.269813] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.271586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.271586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.271586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.271586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.271586] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.271586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.271586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.271586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.271586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.271586] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 already deleted. [ 904.271586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.329668] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-490 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.329874] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-490" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.330096] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-490" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.330432] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-490" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.330803] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.330911] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.332072] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.332371] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.332527] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.332776] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 904.332898] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 904.333022] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 904.333153] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 904.333328] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 904.333399] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 904.333546] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 904.355052] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 904.355052] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 904.355052] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 904.355237] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-490" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.355632] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-cb5da7f4-f2e2-421b-b439-a5d380c314ae taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.356123] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-cb5da7f4-f2e2-421b-b439-a5d380c314ae" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.356350] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-cb5da7f4-f2e2-421b-b439-a5d380c314ae" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.360199] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-cb5da7f4-f2e2-421b-b439-a5d380c314ae" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.366277] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb5da7f4-f2e2-421b-b439-a5d380c314ae',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.440336] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49d65b4d-9206-4925-b862-2ad0f3d9eaf1: rpc.has_security_group_logging(os_id): False [ 904.463603] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.463800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.463840] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.464084] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.464197] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.464559] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.464559] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.464699] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.464814] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.464893] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.465124] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.465238] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.465483] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.465708] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.465884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.466023] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.466208] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.466208] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.466328] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.466404] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.466489] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 is going to be created. [ 904.536758] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.538711] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.538711] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.538711] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.538711] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.553886] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: IN_PROGRESS for 2s [ 904.868262] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.868557] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.868622] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.868872] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.869413] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.869413] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port cb5da7f4-f2e2-421b-b439-a5d380c314ae not found, creating... [ 904.869413] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.869629] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.869662] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.869881] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.870220] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.870380] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.870532] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.871920] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.871920] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.871920] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.871920] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: cb5da7f4-f2e2-421b-b439-a5d380c314ae is going to be created. [ 904.893283] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.894190] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.894190] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.894310] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.894462] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.894685] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-cb5da7f4-f2e2-421b-b439-a5d380c314ae" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.748964] env[66834]: INFO networking_nsxv3.common.synchronization [req-6ca53b9a-a8f3-48ec-be77-963d4ca3bb2b req-5ea186ae-01fa-4ada-9b96-b5baee8525af service nova] Enqueued Resource ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 with Priority: HIGHEST for action security_group_rules [ 905.749572] env[66834]: INFO networking_nsxv3.common.synchronization [req-6ca53b9a-a8f3-48ec-be77-963d4ca3bb2b req-5ea186ae-01fa-4ada-9b96-b5baee8525af service nova] Enqueued Resource ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 with Priority: HIGHEST for action security_group_members [ 905.749572] env[66834]: INFO networking_nsxv3.common.synchronization [req-6ca53b9a-a8f3-48ec-be77-963d4ca3bb2b req-5ea186ae-01fa-4ada-9b96-b5baee8525af service nova] Enqueued Resource ID: cb5da7f4-f2e2-421b-b439-a5d380c314ae with Priority: HIGHEST for action port [ 905.750119] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 with Priority: HIGHEST for action security_group_rules [ 905.750195] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 with Priority: HIGHEST for action security_group_members [ 905.750310] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb5da7f4-f2e2-421b-b439-a5d380c314ae with Priority: HIGHEST for action port [ 905.750643] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ac1b684-ee07-41f3-926b-106a37b82e05 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.750791] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.750870] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.751123] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.751217] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ac1b684-ee07-41f3-926b-106a37b82e05',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.752729] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ac1b684-ee07-41f3-926b-106a37b82e05 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.753132] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.753268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.753478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.753686] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.753849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.753928] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.754156] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.754263] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.754482] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ac1b684-ee07-41f3-926b-106a37b82e05',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.755395] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb5da7f4-f2e2-421b-b439-a5d380c314ae taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.755524] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb5da7f4-f2e2-421b-b439-a5d380c314ae" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.755586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb5da7f4-f2e2-421b-b439-a5d380c314ae" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.755791] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb5da7f4-f2e2-421b-b439-a5d380c314ae" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.755844] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb5da7f4-f2e2-421b-b439-a5d380c314ae',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.258281] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ac1b684-ee07-41f3-926b-106a37b82e05 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.258460] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.258574] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ac1b684-ee07-41f3-926b-106a37b82e05',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.263263] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb5da7f4-f2e2-421b-b439-a5d380c314ae with status ACTIVE [ 906.263487] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.263863] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.263863] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.263956] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.264054] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.264241] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.264338] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.264411] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.264609] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.264678] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.264967] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.264967] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.265100] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.265151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.265227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.265314] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb5da7f4-f2e2-421b-b439-a5d380c314ae is going to be updated. [ 906.298764] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.299075] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.299075] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.299202] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.299350] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.299497] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb5da7f4-f2e2-421b-b439-a5d380c314ae" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.413594] env[66834]: INFO networking_nsxv3.common.synchronization [req-e9d35430-9b24-48c3-98dd-5aab4845c1c4 req-ccad09b5-2917-4a40-b66f-886c772d52f7 tempest-AttachInterfacesTestJSON-77868371 tempest-AttachInterfacesTestJSON-77868371-project-member] Enqueued Resource ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 with Priority: HIGHEST for action security_group_members [ 906.414435] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 with Priority: HIGHEST for action security_group_members [ 906.415376] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-074f3129-4b43-4c6a-91e1-f738692c4d34 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.415454] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.415557] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.415883] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.416073] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.416868] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.416868] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.416868] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.416868] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.416868] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('074f3129-4b43-4c6a-91e1-f738692c4d34',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.568528] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: SUCCESS [ 906.568817] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.568988] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.569315] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.569415] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.761568] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ac1b684-ee07-41f3-926b-106a37b82e05',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.867850] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-106 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.868152] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.868322] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.873026] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.873026] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.873026] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.873026] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.873026] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.873026] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.873026] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 906.873026] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 906.873026] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 906.873026] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 906.873026] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 906.873026] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 906.873026] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 906.911027] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 906.911027] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 906.911027] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 906.911027] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.911027] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-8885f80f-2649-48db-aef0-df5c589bc36e taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.911027] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-8885f80f-2649-48db-aef0-df5c589bc36e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.911027] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-8885f80f-2649-48db-aef0-df5c589bc36e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.911027] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-8885f80f-2649-48db-aef0-df5c589bc36e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.911773] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8885f80f-2649-48db-aef0-df5c589bc36e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.919047] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.920075] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.920252] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.920542] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.921991] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.921991] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.921991] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.921991] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.921991] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.921991] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.921991] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 already deleted. [ 906.921991] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.073313] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.073697] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.073814] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.074234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.074465] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.074563] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.074625] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.074822] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.074929] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.075019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.075485] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.265195] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.265368] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.265368] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.265560] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.265659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.265659] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 is going to be created. [ 907.293907] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.294261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.294372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.294746] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.294965] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.311282] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 in Status: UNINITIALIZED for 2s [ 907.415424] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.415668] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.418049] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.418049] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.418049] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.418049] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 8885f80f-2649-48db-aef0-df5c589bc36e not found, creating... [ 907.418049] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.418049] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.418049] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.418049] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.418049] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.418049] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.419605] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.419605] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.419605] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.419605] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.419605] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 8885f80f-2649-48db-aef0-df5c589bc36e is going to be created. [ 907.448750] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.449046] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.449528] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.449627] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.449908] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.450950] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-8885f80f-2649-48db-aef0-df5c589bc36e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.579583] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.579583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.579583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.579583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.579583] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.579583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.579583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.579583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.579583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.579583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.580052] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.580052] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.580052] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.580333] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.580407] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.580526] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.580606] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.580876] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.581023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.581126] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.581224] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.083434] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49d65b4d-9206-4925-b862-2ad0f3d9eaf1: rpc.has_security_group_logging(os_id): False [ 908.109624] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.109624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.109624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.109932] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.109932] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.110153] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.110249] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.110303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.110539] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.110608] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.110821] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.110929] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.110929] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.111208] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.111327] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.111605] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.111728] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.111798] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.112846] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.112846] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.112846] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 is going to be updated. [ 908.183901] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.184063] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.184133] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.184404] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.184529] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.199867] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: IN_PROGRESS for 2s [ 908.244287] env[66834]: INFO networking_nsxv3.common.synchronization [req-e9d35430-9b24-48c3-98dd-5aab4845c1c4 req-372e9710-f4e5-4740-a85a-28a5e8a4d499 service nova] Enqueued Resource ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 with Priority: HIGHEST for action security_group_rules [ 908.244446] env[66834]: INFO networking_nsxv3.common.synchronization [req-e9d35430-9b24-48c3-98dd-5aab4845c1c4 req-372e9710-f4e5-4740-a85a-28a5e8a4d499 service nova] Enqueued Resource ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 with Priority: HIGHEST for action security_group_members [ 908.245143] env[66834]: INFO networking_nsxv3.common.synchronization [req-e9d35430-9b24-48c3-98dd-5aab4845c1c4 req-372e9710-f4e5-4740-a85a-28a5e8a4d499 service nova] Enqueued Resource ID: 8885f80f-2649-48db-aef0-df5c589bc36e with Priority: HIGHEST for action port [ 908.245720] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 with Priority: HIGHEST for action security_group_rules [ 908.245857] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 with Priority: HIGHEST for action security_group_members [ 908.245956] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8885f80f-2649-48db-aef0-df5c589bc36e with Priority: HIGHEST for action port [ 908.246308] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-074f3129-4b43-4c6a-91e1-f738692c4d34 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.246433] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.246514] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.246727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.246804] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('074f3129-4b43-4c6a-91e1-f738692c4d34',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.247949] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-074f3129-4b43-4c6a-91e1-f738692c4d34 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.248209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.248209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.248402] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.248589] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.248732] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.248798] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.248938] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.249071] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.249171] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('074f3129-4b43-4c6a-91e1-f738692c4d34',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.251716] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-8885f80f-2649-48db-aef0-df5c589bc36e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.251716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8885f80f-2649-48db-aef0-df5c589bc36e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.251716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8885f80f-2649-48db-aef0-df5c589bc36e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.251716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8885f80f-2649-48db-aef0-df5c589bc36e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.251716] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8885f80f-2649-48db-aef0-df5c589bc36e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.631122] env[66834]: INFO networking_nsxv3.common.synchronization [req-06b15302-1b7b-460e-ac41-602657e05311 req-74465e45-e0fe-4629-9feb-0a3ced987015 tempest-ListServersNegativeTestJSON-1125916362 tempest-ListServersNegativeTestJSON-1125916362-project-member] Enqueued Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGHEST for action security_group_members [ 908.631122] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGHEST for action security_group_members [ 908.631122] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-15d6f6bb-21e8-4682-a53e-1cc4b255699f taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.631766] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.631957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.632279] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.632543] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.632750] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.632925] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.633273] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.633454] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.633623] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.753149] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('074f3129-4b43-4c6a-91e1-f738692c4d34',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.753989] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-074f3129-4b43-4c6a-91e1-f738692c4d34 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.754185] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.754494] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8885f80f-2649-48db-aef0-df5c589bc36e with status ACTIVE [ 908.754661] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.754789] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.754897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.755063] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.755158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.755305] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.755420] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.755420] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.755558] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.755596] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.755771] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.755863] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.755917] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.756280] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.756280] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.756372] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8885f80f-2649-48db-aef0-df5c589bc36e is going to be updated. [ 908.777675] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.777841] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.777913] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.778140] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.778249] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.778434] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8885f80f-2649-48db-aef0-df5c589bc36e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.802184] env[66834]: INFO networking_nsxv3.common.synchronization [req-38f2ea54-5673-40d2-8507-af77cafbd862 req-789cb679-9549-40a6-a84f-6331455a6ea9 tempest-ServerActionsTestOtherB-2089780499 tempest-ServerActionsTestOtherB-2089780499-project-member] Enqueued Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_members [ 908.802837] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_members [ 908.803398] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06251551-417e-4f8a-9412-fdb5036f57fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.803499] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.803545] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.803854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.804100] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.804250] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.804410] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.804652] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.804774] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.804910] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.871758] env[66834]: INFO networking_nsxv3.common.synchronization [req-5ec9fca9-c509-4b27-89da-cccfa354fcc3 req-5b412220-ef4b-4c19-9366-9d22fe148a2f tempest-ListServersNegativeTestJSON-1125916362 tempest-ListServersNegativeTestJSON-1125916362-project-member] Enqueued Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGHEST for action security_group_members [ 908.872509] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGHEST for action security_group_members [ 908.872895] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-15d6f6bb-21e8-4682-a53e-1cc4b255699f taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.873026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.139621] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.254919] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('074f3129-4b43-4c6a-91e1-f738692c4d34',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.313144] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.313144] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.313144] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.313144] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.322800] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 in Status: SUCCESS [ 909.323037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.323191] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.323407] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.323594] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.323708] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.323776] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.323944] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.324045] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.324131] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.324228] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ac1b684-ee07-41f3-926b-106a37b82e05',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.335347] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.335347] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.335347] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.335347] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.335347] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.335347] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.335347] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06251551-417e-4f8a-9412-fdb5036f57fe is going to be updated. [ 909.364324] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.364324] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.364324] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.364324] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.364486] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.374307] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: IN_PROGRESS for 2s [ 909.413358] env[66834]: INFO networking_nsxv3.common.synchronization [req-4bad6cfc-1131-4786-999e-ad3a1392991f req-569287b8-e530-427e-b5f6-7b32384b13a9 tempest-MultipleCreateTestJSON-60451393 tempest-MultipleCreateTestJSON-60451393-project-member] Enqueued Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_members [ 909.413928] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_members [ 909.414320] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.414468] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.414568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.414792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.414976] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.415100] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.415164] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.415322] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.415406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.417045] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.621549] env[66834]: INFO networking_nsxv3.common.synchronization [req-7ee7a0e7-fe98-428c-875c-4fed2c47dea8 req-2bb9c461-8f30-4163-9ffd-ee3e165b97aa tempest-MultipleCreateTestJSON-60451393 tempest-MultipleCreateTestJSON-60451393-project-member] Enqueued Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_members [ 909.621549] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_members [ 909.621885] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.621977] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.641438] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.758970] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.760592] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.760592] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.760798] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.760889] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.761026] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 is going to be created. [ 909.786329] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.786511] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.786557] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.787061] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.787061] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.799031] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 in Status: UNINITIALIZED for 2s [ 909.828905] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ac1b684-ee07-41f3-926b-106a37b82e05',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.920983] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.145031] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.145351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.145351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.146131] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.146131] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.146131] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f is going to be updated. [ 910.151924] env[66834]: INFO networking_nsxv3.common.synchronization [req-482f55ec-465c-4a8e-8653-3447c4191650 req-831f24dd-bfef-478d-95e8-ff8ced48618c tempest-ServerActionsTestOtherA-283121819 tempest-ServerActionsTestOtherA-283121819-project-member] Enqueued Resource ID: 673eef00-b174-4a71-a870-466f27b577fd with Priority: HIGHEST for action security_group_members [ 910.153308] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 673eef00-b174-4a71-a870-466f27b577fd with Priority: HIGHEST for action security_group_members [ 910.153308] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-673eef00-b174-4a71-a870-466f27b577fd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.153308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.153308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.153308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.153894] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.153894] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.153894] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.154124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.154124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.154124] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('673eef00-b174-4a71-a870-466f27b577fd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.184753] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.184983] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.184983] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.185194] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.185518] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.227501] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f in Status: IN_PROGRESS for 2s [ 910.236164] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: SUCCESS [ 910.237174] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.332063] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ac1b684-ee07-41f3-926b-106a37b82e05: rpc.has_security_group_logging(os_id): False [ 910.353648] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.353820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.354016] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.354177] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.354387] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.354647] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.354647] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.354647] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.354761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.354761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.354869] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 is going to be created. [ 910.423519] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.423665] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.423754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.423939] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.424124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.425252] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.438378] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 in Status: IN_PROGRESS for 2s [ 910.616722] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.616965] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-590" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.617103] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-590" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.617404] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-590" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.617702] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.617904] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.618067] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.619027] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.619027] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.619027] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.619027] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 910.619027] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 910.619027] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 910.619027] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.619392] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 910.619392] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 910.642876] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 910.644235] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 910.644235] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 910.644235] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-590" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.644235] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-ac3e57a2-76f1-48c8-a3bc-cb62c127a81e taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.644235] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-ac3e57a2-76f1-48c8-a3bc-cb62c127a81e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.644235] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-ac3e57a2-76f1-48c8-a3bc-cb62c127a81e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.644596] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-ac3e57a2-76f1-48c8-a3bc-cb62c127a81e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.644664] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac3e57a2-76f1-48c8-a3bc-cb62c127a81e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.656787] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.658218] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.658218] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.658218] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.658218] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.658218] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.658218] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.658218] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.658667] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.658667] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.658667] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 673eef00-b174-4a71-a870-466f27b577fd already deleted. [ 910.658667] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.928257] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.928417] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.928489] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.928704] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.928795] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.928891] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 is going to be updated. [ 910.959261] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.959401] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.959472] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.959678] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.959822] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.970086] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: IN_PROGRESS for 2s [ 911.150023] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.150023] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.150023] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.150023] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.150023] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.150023] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port ac3e57a2-76f1-48c8-a3bc-cb62c127a81e not found, creating... [ 911.150699] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.150699] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.150777] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.154019] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.154019] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.154019] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.154019] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.154019] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.154019] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.154019] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.154019] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: ac3e57a2-76f1-48c8-a3bc-cb62c127a81e is going to be created. [ 911.172596] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.172811] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.172922] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.173210] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.173433] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.173651] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-ac3e57a2-76f1-48c8-a3bc-cb62c127a81e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.384585] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: SUCCESS [ 911.384916] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06251551-417e-4f8a-9412-fdb5036f57fe deletion is rescheduled due to dependency. [ 911.384988] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.811613] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 in Status: SUCCESS [ 911.812498] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.812498] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.812498] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.812498] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.812727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.812727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.812816] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.812885] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.812977] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.813094] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('074f3129-4b43-4c6a-91e1-f738692c4d34',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.930206] env[66834]: INFO networking_nsxv3.common.synchronization [req-482f55ec-465c-4a8e-8653-3447c4191650 req-501774f3-199c-49a5-b018-e9df01a52b8c service nova] Enqueued Resource ID: 673eef00-b174-4a71-a870-466f27b577fd with Priority: HIGHEST for action security_group_rules [ 911.930441] env[66834]: INFO networking_nsxv3.common.synchronization [req-482f55ec-465c-4a8e-8653-3447c4191650 req-501774f3-199c-49a5-b018-e9df01a52b8c service nova] Enqueued Resource ID: 673eef00-b174-4a71-a870-466f27b577fd with Priority: HIGHEST for action security_group_members [ 911.930553] env[66834]: INFO networking_nsxv3.common.synchronization [req-482f55ec-465c-4a8e-8653-3447c4191650 req-501774f3-199c-49a5-b018-e9df01a52b8c service nova] Enqueued Resource ID: ac3e57a2-76f1-48c8-a3bc-cb62c127a81e with Priority: HIGHEST for action port [ 911.931151] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 673eef00-b174-4a71-a870-466f27b577fd with Priority: HIGHEST for action security_group_rules [ 911.933700] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 673eef00-b174-4a71-a870-466f27b577fd with Priority: HIGHEST for action security_group_members [ 911.933700] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3e57a2-76f1-48c8-a3bc-cb62c127a81e with Priority: HIGHEST for action port [ 911.933700] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-673eef00-b174-4a71-a870-466f27b577fd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.933700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.933700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.933700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.933700] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('673eef00-b174-4a71-a870-466f27b577fd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.933700] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-673eef00-b174-4a71-a870-466f27b577fd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.933700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.933700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.933700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.933700] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.934226] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.934226] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.934226] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.934226] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.934226] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('673eef00-b174-4a71-a870-466f27b577fd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.936832] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac3e57a2-76f1-48c8-a3bc-cb62c127a81e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.936832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac3e57a2-76f1-48c8-a3bc-cb62c127a81e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.936832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac3e57a2-76f1-48c8-a3bc-cb62c127a81e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.936832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac3e57a2-76f1-48c8-a3bc-cb62c127a81e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.936832] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac3e57a2-76f1-48c8-a3bc-cb62c127a81e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.241172] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f in Status: SUCCESS [ 912.241172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.241172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.241172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.241172] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.241667] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.241667] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.241667] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.241667] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.241667] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.316029] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('074f3129-4b43-4c6a-91e1-f738692c4d34',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.437409] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-673eef00-b174-4a71-a870-466f27b577fd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.438285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.438285] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('673eef00-b174-4a71-a870-466f27b577fd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.438744] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac3e57a2-76f1-48c8-a3bc-cb62c127a81e with status ACTIVE [ 912.439105] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.439179] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.439323] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.439771] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.439771] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.439993] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.441177] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.441270] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.441549] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.441667] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.441937] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.442074] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.442171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.442413] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.442535] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.442631] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac3e57a2-76f1-48c8-a3bc-cb62c127a81e is going to be updated. [ 912.467189] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 in Status: SUCCESS [ 912.467457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.475908] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.476124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.476195] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.476431] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.476553] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.476734] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac3e57a2-76f1-48c8-a3bc-cb62c127a81e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.745462] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.745462] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.745462] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.745462] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.745462] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.745874] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.747041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.747041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.747041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.747041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.747041] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f is going to be updated. [ 912.788060] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.788296] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.790378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.790378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.790378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.802628] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f in Status: IN_PROGRESS for 2s [ 912.818484] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 074f3129-4b43-4c6a-91e1-f738692c4d34: rpc.has_security_group_logging(os_id): False [ 912.842865] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.842865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.842865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.842865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.843162] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.843269] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.843387] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.843454] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.843605] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.843682] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.843770] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 is going to be created. [ 912.877894] env[66834]: INFO networking_nsxv3.common.synchronization [req-9b7f1afe-6e8c-4426-9c4f-5da8c7510268 req-0f207c23-7ac0-4cb8-9aa6-7a42d042cb6e tempest-AttachInterfacesV270Test-2038816931 tempest-AttachInterfacesV270Test-2038816931-project-member] Enqueued Resource ID: d46470ac-aa4d-4eff-9d79-fb152af42f68 with Priority: HIGHEST for action security_group_members [ 912.878457] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46470ac-aa4d-4eff-9d79-fb152af42f68 with Priority: HIGHEST for action security_group_members [ 912.878889] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46470ac-aa4d-4eff-9d79-fb152af42f68 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.879015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.879015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.879389] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.879625] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.879773] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.879837] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.880076] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.880234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.880293] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d46470ac-aa4d-4eff-9d79-fb152af42f68',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.945445] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('673eef00-b174-4a71-a870-466f27b577fd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.035262] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: SUCCESS [ 913.035466] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.035719] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.036138] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.036243] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.037124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.037124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.037124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.037124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.037124] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.040775] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.040936] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.041059] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.041358] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.041404] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.056592] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 in Status: IN_PROGRESS for 2s [ 913.188366] env[66834]: INFO networking_nsxv3.common.synchronization [req-8a01c7fd-1785-4a0b-af41-3fec645b9eba req-e261d677-1793-4b0c-9b33-fa11d8569d71 tempest-ServersAdminTestJSON-835845617 tempest-ServersAdminTestJSON-835845617-project-member] Enqueued Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_members [ 913.188919] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_members [ 913.190081] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.190081] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.190081] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.190081] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.190081] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.190081] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.190081] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.190557] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.190557] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.190557] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.362020] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-235 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.362401] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-235" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.362452] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-235" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.362875] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-235" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.363247] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.364150] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.364279] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.364524] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.364742] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.365027] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 913.365213] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 913.365350] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 913.365491] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 913.365735] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 913.366050] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 913.366050] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 913.382541] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.382862] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.383239] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.383706] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.383706] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.384648] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.384648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.384648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.384648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.384648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.384907] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46470ac-aa4d-4eff-9d79-fb152af42f68 already deleted. [ 913.385991] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.386600] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 913.386861] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 913.387034] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 913.387230] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-235" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.387515] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-85c749f2-1b80-42a5-9ce8-ccbf56ce5e18 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.387678] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-85c749f2-1b80-42a5-9ce8-ccbf56ce5e18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.387797] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-85c749f2-1b80-42a5-9ce8-ccbf56ce5e18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.388091] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-85c749f2-1b80-42a5-9ce8-ccbf56ce5e18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.388230] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85c749f2-1b80-42a5-9ce8-ccbf56ce5e18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.451830] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.451830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.451830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.451830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.451830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.451830] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 673eef00-b174-4a71-a870-466f27b577fd is going to be created. [ 913.479379] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.479529] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.479601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.479844] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.480146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.491564] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 673eef00-b174-4a71-a870-466f27b577fd in Status: UNINITIALIZED for 2s [ 913.539538] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.539723] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.539723] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.540076] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.540200] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.540402] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.540501] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.540575] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.540736] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.540814] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.540921] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 is going to be updated. [ 913.567479] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.567636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.567673] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.568229] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.568229] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.581017] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: IN_PROGRESS for 2s [ 913.692733] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.890673] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.891017] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.891126] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.891902] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.891902] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.891902] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 85c749f2-1b80-42a5-9ce8-ccbf56ce5e18 not found, creating... [ 913.891902] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.892119] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.892261] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.892385] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.892511] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.893423] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.893423] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.893423] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.893423] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.893697] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.893697] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 85c749f2-1b80-42a5-9ce8-ccbf56ce5e18 is going to be created. [ 913.918429] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.918648] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.918941] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.919258] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.919490] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.919726] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-85c749f2-1b80-42a5-9ce8-ccbf56ce5e18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.195459] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.618287] env[66834]: INFO networking_nsxv3.common.synchronization [req-9b7f1afe-6e8c-4426-9c4f-5da8c7510268 req-2c31ce29-da16-4c9c-a534-6e2310b9c214 service nova] Enqueued Resource ID: d46470ac-aa4d-4eff-9d79-fb152af42f68 with Priority: HIGHEST for action security_group_rules [ 914.618567] env[66834]: INFO networking_nsxv3.common.synchronization [req-9b7f1afe-6e8c-4426-9c4f-5da8c7510268 req-2c31ce29-da16-4c9c-a534-6e2310b9c214 service nova] Enqueued Resource ID: d46470ac-aa4d-4eff-9d79-fb152af42f68 with Priority: HIGHEST for action security_group_members [ 914.618567] env[66834]: INFO networking_nsxv3.common.synchronization [req-9b7f1afe-6e8c-4426-9c4f-5da8c7510268 req-2c31ce29-da16-4c9c-a534-6e2310b9c214 service nova] Enqueued Resource ID: 85c749f2-1b80-42a5-9ce8-ccbf56ce5e18 with Priority: HIGHEST for action port [ 914.619208] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46470ac-aa4d-4eff-9d79-fb152af42f68 with Priority: HIGHEST for action security_group_rules [ 914.619339] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46470ac-aa4d-4eff-9d79-fb152af42f68 with Priority: HIGHEST for action security_group_members [ 914.619426] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85c749f2-1b80-42a5-9ce8-ccbf56ce5e18 with Priority: HIGHEST for action port [ 914.619897] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d46470ac-aa4d-4eff-9d79-fb152af42f68 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.619897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.619897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.622029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.622029] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d46470ac-aa4d-4eff-9d79-fb152af42f68',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.622740] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46470ac-aa4d-4eff-9d79-fb152af42f68 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.622858] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.622927] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.623105] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.623256] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.623352] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.623419] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.623551] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.623649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.623709] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d46470ac-aa4d-4eff-9d79-fb152af42f68',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.625574] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-85c749f2-1b80-42a5-9ce8-ccbf56ce5e18 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.625706] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85c749f2-1b80-42a5-9ce8-ccbf56ce5e18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.625804] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85c749f2-1b80-42a5-9ce8-ccbf56ce5e18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.626691] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85c749f2-1b80-42a5-9ce8-ccbf56ce5e18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.626691] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85c749f2-1b80-42a5-9ce8-ccbf56ce5e18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.699288] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.699288] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.699288] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.699288] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.699288] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.699288] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9276c5a5-af43-4c6e-899f-c34039400160 is going to be updated. [ 914.731347] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.731549] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.731549] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.731787] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.731924] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.743087] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: IN_PROGRESS for 2s [ 914.813115] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f in Status: SUCCESS [ 914.813405] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f deletion is rescheduled due to dependency. [ 914.813591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.071954] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 in Status: SUCCESS [ 915.072212] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.127761] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d46470ac-aa4d-4eff-9d79-fb152af42f68',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.129144] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46470ac-aa4d-4eff-9d79-fb152af42f68 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.129144] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.129333] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 85c749f2-1b80-42a5-9ce8-ccbf56ce5e18 with status ACTIVE [ 915.129333] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.129415] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.129515] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.129684] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.129764] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.130097] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.130097] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.130363] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.130544] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.130621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.130853] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.130996] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.131133] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.131436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.131509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.131610] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 85c749f2-1b80-42a5-9ce8-ccbf56ce5e18 is going to be updated. [ 915.152276] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.152433] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.152494] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.152687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.152827] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.152982] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85c749f2-1b80-42a5-9ce8-ccbf56ce5e18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.502229] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 673eef00-b174-4a71-a870-466f27b577fd in Status: SUCCESS [ 915.502471] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.502650] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.502884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.503098] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.503227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.503301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.503472] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.503552] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.503639] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.503743] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('673eef00-b174-4a71-a870-466f27b577fd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.590734] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: SUCCESS [ 915.590864] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 deletion is rescheduled due to dependency. [ 915.590985] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.633812] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d46470ac-aa4d-4eff-9d79-fb152af42f68',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.006930] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-673eef00-b174-4a71-a870-466f27b577fd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.007142] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.007216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.007445] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.007614] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.007719] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.007814] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.007992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.008120] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.008217] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.008368] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-673eef00-b174-4a71-a870-466f27b577fd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.008627] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.008698] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.008865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.009123] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.009217] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.009298] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.009449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.009608] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.009695] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.009753] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('673eef00-b174-4a71-a870-466f27b577fd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.136546] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.136705] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.136739] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.136982] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.137046] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.138483] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46470ac-aa4d-4eff-9d79-fb152af42f68 is going to be created. [ 916.166381] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.166381] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.166381] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.166381] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.166381] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.178221] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46470ac-aa4d-4eff-9d79-fb152af42f68 in Status: UNINITIALIZED for 2s [ 916.373877] env[66834]: INFO networking_nsxv3.common.synchronization [None req-2423d84d-6190-4a22-9783-2a42e6b7143e tempest-ServerDiskConfigTestJSON-362503924 tempest-ServerDiskConfigTestJSON-362503924-project-member] Enqueued Resource ID: 0ffeb4e3-20f2-417a-a50f-01ca367ca507 with Priority: HIGHEST for action security_group_rules [ 916.374442] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ffeb4e3-20f2-417a-a50f-01ca367ca507 with Priority: HIGHEST for action security_group_rules [ 916.374742] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ffeb4e3-20f2-417a-a50f-01ca367ca507 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.374901] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ffeb4e3-20f2-417a-a50f-01ca367ca507" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.375113] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ffeb4e3-20f2-417a-a50f-01ca367ca507" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.375173] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ffeb4e3-20f2-417a-a50f-01ca367ca507" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.375264] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ffeb4e3-20f2-417a-a50f-01ca367ca507',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.504338] env[66834]: INFO networking_nsxv3.common.synchronization [None req-111ca865-2991-4dce-b559-400170c5de3d tempest-ServerDiskConfigTestJSON-362503924 tempest-ServerDiskConfigTestJSON-362503924-project-member] Enqueued Resource ID: 0ffeb4e3-20f2-417a-a50f-01ca367ca507 with Priority: HIGHEST for action security_group_rules [ 916.504810] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ffeb4e3-20f2-417a-a50f-01ca367ca507 with Priority: HIGHEST for action security_group_rules [ 916.505062] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ffeb4e3-20f2-417a-a50f-01ca367ca507 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.505221] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ffeb4e3-20f2-417a-a50f-01ca367ca507" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.512532] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 673eef00-b174-4a71-a870-466f27b577fd: rpc.has_security_group_logging(os_id): False [ 916.531797] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.531887] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.531951] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.532190] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.532280] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.532525] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.532630] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.532694] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.532847] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.532924] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.533221] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.536103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.536278] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.536499] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.536587] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.537095] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.537399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.537475] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.539054] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.539165] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.539331] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 673eef00-b174-4a71-a870-466f27b577fd is going to be created. [ 916.611307] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.611476] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.611533] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.611721] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.611898] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.623745] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 673eef00-b174-4a71-a870-466f27b577fd in Status: IN_PROGRESS for 2s [ 916.755723] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: SUCCESS [ 916.757416] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.902599] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.902873] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.902982] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.903251] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.903329] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.903431] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ffeb4e3-20f2-417a-a50f-01ca367ca507 already deleted. [ 916.903520] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ffeb4e3-20f2-417a-a50f-01ca367ca507" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.903729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ffeb4e3-20f2-417a-a50f-01ca367ca507" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.903890] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ffeb4e3-20f2-417a-a50f-01ca367ca507" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.903984] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ffeb4e3-20f2-417a-a50f-01ca367ca507',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.426037] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.426177] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.426239] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.426461] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.426550] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.426648] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ffeb4e3-20f2-417a-a50f-01ca367ca507 already deleted. [ 917.426824] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ffeb4e3-20f2-417a-a50f-01ca367ca507" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.188353] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46470ac-aa4d-4eff-9d79-fb152af42f68 in Status: SUCCESS [ 918.188708] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.188748] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.189227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.190657] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.190657] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.190657] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.190657] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.190657] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.190657] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.190657] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d46470ac-aa4d-4eff-9d79-fb152af42f68',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.641875] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 673eef00-b174-4a71-a870-466f27b577fd in Status: SUCCESS [ 918.642121] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.694835] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46470ac-aa4d-4eff-9d79-fb152af42f68 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.695115] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.695115] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.695330] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.695518] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.695652] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.695652] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.695851] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.695932] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.696030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.696187] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46470ac-aa4d-4eff-9d79-fb152af42f68 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.696299] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.696362] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.696568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.696794] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.696917] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.696979] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.697140] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.697220] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.697303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.697407] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d46470ac-aa4d-4eff-9d79-fb152af42f68',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.200408] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d46470ac-aa4d-4eff-9d79-fb152af42f68: rpc.has_security_group_logging(os_id): False [ 919.228393] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.228761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.228761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.228872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.228932] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.230074] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.230074] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.230074] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.230074] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.230074] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.230074] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.230074] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.230074] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.230793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.230909] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.231122] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.231229] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.231282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.231471] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.231547] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.231635] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d46470ac-aa4d-4eff-9d79-fb152af42f68 is going to be created. [ 919.318133] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.318133] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.318133] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.318133] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.318287] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.330141] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d46470ac-aa4d-4eff-9d79-fb152af42f68 in Status: IN_PROGRESS for 2s [ 919.866789] env[66834]: INFO networking_nsxv3.common.synchronization [req-714d6816-77b2-477b-a0c1-78b554d047cb req-acc4f9e4-f7a8-4736-9264-a52548df953c tempest-ServersWithSpecificFlavorTestJSON-2029331566 tempest-ServersWithSpecificFlavorTestJSON-2029331566-project-member] Enqueued Resource ID: 9c3590f1-016a-4b00-b83e-f52f030b948b with Priority: HIGHEST for action security_group_members [ 919.867077] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c3590f1-016a-4b00-b83e-f52f030b948b with Priority: HIGHEST for action security_group_members [ 919.868279] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c3590f1-016a-4b00-b83e-f52f030b948b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.868412] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.868478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.868709] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.868880] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.868987] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.869092] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.869307] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.869409] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.871036] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c3590f1-016a-4b00-b83e-f52f030b948b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.375135] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.375450] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.375450] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.376702] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.376702] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.377291] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.377291] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.377291] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.377632] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.377701] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.377857] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c3590f1-016a-4b00-b83e-f52f030b948b is going to be updated. [ 920.411339] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.411535] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.412025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.412025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.412025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.423887] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c3590f1-016a-4b00-b83e-f52f030b948b in Status: IN_PROGRESS for 2s [ 920.605711] env[66834]: INFO networking_nsxv3.common.synchronization [req-bb4b290d-178b-4feb-8128-4c754a92ac5e req-ef76aa3b-cb86-4bca-b561-7fbd1a2d06bd tempest-ImagesTestJSON-910661197 tempest-ImagesTestJSON-910661197-project-member] Enqueued Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 920.606273] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 920.606585] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.606701] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.606768] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.606970] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.607131] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.607716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.607896] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.607969] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.608060] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.608183] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.950823] env[66834]: INFO networking_nsxv3.common.synchronization [req-9cbf180a-8608-4aac-a54d-cd6b2da3dc6f req-2da02071-5507-4d61-8005-b270ad1c189c tempest-ServerDiskConfigTestJSON-362503924 tempest-ServerDiskConfigTestJSON-362503924-project-member] Enqueued Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 920.950823] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 920.950823] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.950823] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.950823] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.950823] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.950823] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.951095] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.951095] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.951095] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.951176] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.951312] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.110724] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.110925] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.110925] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.111127] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.111332] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.111549] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.111655] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.111721] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.111891] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.111969] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.112079] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 is going to be updated. [ 921.143024] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.143024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.143213] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.143314] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.143449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.152775] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: IN_PROGRESS for 2s [ 921.361065] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d46470ac-aa4d-4eff-9d79-fb152af42f68 in Status: SUCCESS [ 921.361291] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.453617] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.453930] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.453930] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.454139] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.454267] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.454545] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.455191] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.455191] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.455191] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.455191] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.455191] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7963c125-23b5-45fd-8158-f6470d12949e is going to be updated. [ 921.486707] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.486707] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.487166] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.487166] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.487166] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.497863] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: IN_PROGRESS for 2s [ 922.434771] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c3590f1-016a-4b00-b83e-f52f030b948b in Status: SUCCESS [ 922.434771] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c3590f1-016a-4b00-b83e-f52f030b948b deletion is rescheduled due to dependency. [ 922.434976] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.167314] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: SUCCESS [ 923.167314] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 deletion is rescheduled due to dependency. [ 923.167314] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.450219] env[66834]: INFO networking_nsxv3.common.synchronization [req-b7c2c328-79e3-4e7b-a170-e98b00e76367 req-5671fc96-149f-4285-9503-d3938901eb21 tempest-MigrationsAdminTest-1673437967 tempest-MigrationsAdminTest-1673437967-project-member] Enqueued Resource ID: f46326b4-7843-4c05-8eca-cb73edd99c30 with Priority: HIGHEST for action security_group_members [ 923.450219] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f46326b4-7843-4c05-8eca-cb73edd99c30 with Priority: HIGHEST for action security_group_members [ 923.452811] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-f46326b4-7843-4c05-8eca-cb73edd99c30 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.453009] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.453139] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.453299] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.453462] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.453639] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.453639] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.453761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.453845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.453944] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f46326b4-7843-4c05-8eca-cb73edd99c30',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.509141] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: SUCCESS [ 923.509289] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7963c125-23b5-45fd-8158-f6470d12949e deletion is rescheduled due to dependency. [ 923.509393] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.958567] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.958806] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.958806] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.959073] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.959186] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.959407] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.959534] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.959597] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.959766] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.959855] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.959946] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f46326b4-7843-4c05-8eca-cb73edd99c30 is going to be updated. [ 924.001052] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.001052] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.001313] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.001973] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.001973] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.026557] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f46326b4-7843-4c05-8eca-cb73edd99c30 in Status: IN_PROGRESS for 2s [ 925.450495] env[66834]: INFO networking_nsxv3.common.synchronization [req-1c00da30-d927-41f3-8cb1-f36f587d11cc req-be39a116-cc35-436d-b819-38dfcb0cdd2d tempest-ServersNegativeTestJSON-499609681 tempest-ServersNegativeTestJSON-499609681-project-member] Enqueued Resource ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c with Priority: HIGHEST for action security_group_members [ 925.451382] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c with Priority: HIGHEST for action security_group_members [ 925.451811] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.452889] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.452994] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.453315] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.454130] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.454130] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.454130] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.454130] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.454258] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.454290] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.545956] env[66834]: INFO networking_nsxv3.common.synchronization [req-c62a4036-95fd-4915-840c-6f55585a4875 req-47b1bbef-cc33-48af-9fbd-b99e52f8cd5a tempest-ListImageFiltersTestJSON-1653843489 tempest-ListImageFiltersTestJSON-1653843489-project-member] Enqueued Resource ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd with Priority: HIGHEST for action security_group_members [ 925.546998] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd with Priority: HIGHEST for action security_group_members [ 925.546998] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.546998] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.547174] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.547335] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.547488] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.547591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.547652] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.547799] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.547883] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.547974] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e7c2a7-894d-4c35-9c95-4f7fee507dfd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.827953] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-615 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.827953] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-615" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.827953] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-615" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.828223] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-615" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.828653] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.828822] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.828939] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.829193] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.829343] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.829552] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 925.829663] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 925.829768] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 925.829874] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 925.829978] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 925.830118] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 925.830260] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 925.852037] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 925.852298] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 925.852464] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 925.853051] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-615" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.853327] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-26c8f1d5-7ed3-43ae-ba52-07e7d472257f taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.853641] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-26c8f1d5-7ed3-43ae-ba52-07e7d472257f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.853748] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-26c8f1d5-7ed3-43ae-ba52-07e7d472257f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.854057] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-26c8f1d5-7ed3-43ae-ba52-07e7d472257f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.854222] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26c8f1d5-7ed3-43ae-ba52-07e7d472257f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.956919] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.038570] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f46326b4-7843-4c05-8eca-cb73edd99c30 in Status: SUCCESS [ 926.038570] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f46326b4-7843-4c05-8eca-cb73edd99c30 deletion is rescheduled due to dependency. [ 926.038570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f46326b4-7843-4c05-8eca-cb73edd99c30" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.050724] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.051118] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.051756] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.051756] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.051756] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.051897] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.051897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.051978] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.052677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.052677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.052677] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd is going to be updated. [ 926.086584] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.086778] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.086827] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.087047] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.087226] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.097461] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd in Status: IN_PROGRESS for 2s [ 926.358422] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.358673] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.358815] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.359247] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.361077] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.361077] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 26c8f1d5-7ed3-43ae-ba52-07e7d472257f not found, creating... [ 926.361077] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.361979] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.362184] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.362486] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.362917] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.363026] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.363171] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.363268] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.363647] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.363647] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.363873] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 26c8f1d5-7ed3-43ae-ba52-07e7d472257f is going to be created. [ 926.365981] env[66834]: INFO networking_nsxv3.common.synchronization [req-186f606d-9f67-4fc9-add7-deaf6f23ce47 req-27350ae5-01d3-4b18-8724-e036b919917f tempest-ServerActionsTestJSON-2105447671 tempest-ServerActionsTestJSON-2105447671-project-member] Enqueued Resource ID: b372a601-425a-4557-bfbf-2682fc337d0d with Priority: HIGHEST for action security_group_members [ 926.366230] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b372a601-425a-4557-bfbf-2682fc337d0d with Priority: HIGHEST for action security_group_members [ 926.366946] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-b372a601-425a-4557-bfbf-2682fc337d0d taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.367123] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.367225] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.367439] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.367581] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.367690] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.367772] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.367894] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.367972] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.368081] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b372a601-425a-4557-bfbf-2682fc337d0d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.386759] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.386963] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.387103] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.387455] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.387695] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.387938] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-26c8f1d5-7ed3-43ae-ba52-07e7d472257f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.459938] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.869790] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.869988] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.870054] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.870346] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.870443] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.870642] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.870751] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.870811] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.870963] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.871050] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.871136] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b372a601-425a-4557-bfbf-2682fc337d0d is going to be updated. [ 926.963158] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.963158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.963158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.963561] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.963561] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.963561] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c is going to be updated. [ 926.977892] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.978093] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.978176] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.978386] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.978534] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.006038] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b372a601-425a-4557-bfbf-2682fc337d0d in Status: IN_PROGRESS for 2s [ 927.045231] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.045489] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.045580] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.045850] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.046011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.064744] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c in Status: IN_PROGRESS for 2s [ 927.117800] env[66834]: INFO networking_nsxv3.common.synchronization [req-1c00da30-d927-41f3-8cb1-f36f587d11cc req-f0808075-163e-4345-a2f0-8aced41428c8 service nova] Enqueued Resource ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c with Priority: HIGHEST for action security_group_rules [ 927.118155] env[66834]: INFO networking_nsxv3.common.synchronization [req-1c00da30-d927-41f3-8cb1-f36f587d11cc req-f0808075-163e-4345-a2f0-8aced41428c8 service nova] Enqueued Resource ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c with Priority: HIGHEST for action security_group_members [ 927.118322] env[66834]: INFO networking_nsxv3.common.synchronization [req-1c00da30-d927-41f3-8cb1-f36f587d11cc req-f0808075-163e-4345-a2f0-8aced41428c8 service nova] Enqueued Resource ID: 26c8f1d5-7ed3-43ae-ba52-07e7d472257f with Priority: HIGHEST for action port [ 927.118957] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c with Priority: HIGHEST for action security_group_rules [ 927.119125] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c with Priority: HIGHEST for action security_group_members [ 927.119282] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26c8f1d5-7ed3-43ae-ba52-07e7d472257f with Priority: HIGHEST for action port [ 927.119649] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.119783] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.119847] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.120070] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.120176] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.121891] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.122031] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.122263] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-26c8f1d5-7ed3-43ae-ba52-07e7d472257f taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.122389] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26c8f1d5-7ed3-43ae-ba52-07e7d472257f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.122447] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26c8f1d5-7ed3-43ae-ba52-07e7d472257f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.122626] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26c8f1d5-7ed3-43ae-ba52-07e7d472257f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.122985] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26c8f1d5-7ed3-43ae-ba52-07e7d472257f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.626167] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.626167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.626167] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 26c8f1d5-7ed3-43ae-ba52-07e7d472257f with status ACTIVE [ 927.626167] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.626167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.626167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.626167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.626167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.626167] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.626167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.626761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.626761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.626761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.626761] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.626761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.627029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.627029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.627088] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.627210] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 26c8f1d5-7ed3-43ae-ba52-07e7d472257f is going to be updated. [ 927.652139] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.652301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.652364] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.652685] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.652822] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.652985] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26c8f1d5-7ed3-43ae-ba52-07e7d472257f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.023307] env[66834]: INFO networking_nsxv3.common.synchronization [req-e743499e-83c2-4538-b663-a9669c87d0a2 req-cc983bb0-fe87-45ae-9fe0-27158099092f tempest-ServersTestJSON-861266990 tempest-ServersTestJSON-861266990-project-member] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 928.023307] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 928.023387] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.023526] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.023593] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.023787] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.024076] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.024076] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.024188] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.024272] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.024356] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.024450] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.108381] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd in Status: SUCCESS [ 928.108574] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd deletion is rescheduled due to dependency. [ 928.108695] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.392397] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-849 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.392397] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.392609] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.392805] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.393075] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.393238] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.393474] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.393560] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.393700] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.393908] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 928.394621] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 928.394835] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 928.394961] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 928.395201] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 928.395201] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 928.395345] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 928.415513] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 928.415513] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 928.415745] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 928.415858] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.416144] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-bf91be69-0115-47d1-b6e9-23f54b79cb00 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.416320] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-bf91be69-0115-47d1-b6e9-23f54b79cb00" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.416466] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-bf91be69-0115-47d1-b6e9-23f54b79cb00" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.416777] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-bf91be69-0115-47d1-b6e9-23f54b79cb00" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.416958] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf91be69-0115-47d1-b6e9-23f54b79cb00',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.526829] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.919748] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.920143] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.920143] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.920462] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.920609] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.920763] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port bf91be69-0115-47d1-b6e9-23f54b79cb00 not found, creating... [ 928.921559] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.921559] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.921559] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.921559] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.921857] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.921953] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.922125] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.922239] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.922443] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.922570] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.922707] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: bf91be69-0115-47d1-b6e9-23f54b79cb00 is going to be created. [ 928.948669] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.948975] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.949186] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.949618] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.949853] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.950178] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-bf91be69-0115-47d1-b6e9-23f54b79cb00" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.023596] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b372a601-425a-4557-bfbf-2682fc337d0d in Status: SUCCESS [ 929.023768] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b372a601-425a-4557-bfbf-2682fc337d0d deletion is rescheduled due to dependency. [ 929.023829] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.029452] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.085172] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c in Status: SUCCESS [ 929.085172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.085172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.085172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.085172] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.085172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.085172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.086117] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.086117] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.086117] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.532090] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.532423] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.532607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.532872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.533011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.533149] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be updated. [ 929.573443] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.574064] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.574206] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.574473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.575036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.587620] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.590318] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 929.673089] env[66834]: INFO networking_nsxv3.common.synchronization [req-e743499e-83c2-4538-b663-a9669c87d0a2 req-2f151b30-0175-4bb3-b5bd-8d809cc03f5b service nova] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_rules [ 929.673196] env[66834]: INFO networking_nsxv3.common.synchronization [req-e743499e-83c2-4538-b663-a9669c87d0a2 req-2f151b30-0175-4bb3-b5bd-8d809cc03f5b service nova] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 929.673275] env[66834]: INFO networking_nsxv3.common.synchronization [req-e743499e-83c2-4538-b663-a9669c87d0a2 req-2f151b30-0175-4bb3-b5bd-8d809cc03f5b service nova] Enqueued Resource ID: bf91be69-0115-47d1-b6e9-23f54b79cb00 with Priority: HIGHEST for action port [ 929.673797] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_rules [ 929.673932] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 929.674038] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf91be69-0115-47d1-b6e9-23f54b79cb00 with Priority: HIGHEST for action port [ 929.674318] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.674436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.674493] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.674689] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.674769] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.675588] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.675685] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.675871] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf91be69-0115-47d1-b6e9-23f54b79cb00 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.675960] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf91be69-0115-47d1-b6e9-23f54b79cb00" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.676039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf91be69-0115-47d1-b6e9-23f54b79cb00" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.676926] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf91be69-0115-47d1-b6e9-23f54b79cb00" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.676926] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf91be69-0115-47d1-b6e9-23f54b79cb00',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.091800] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.182601] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.182601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.182601] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf91be69-0115-47d1-b6e9-23f54b79cb00 with status ACTIVE [ 930.182601] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.182601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.182601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.182601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.182601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.182601] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.182601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.182601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.183992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.183992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.183992] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.183992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.183992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.183992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.183992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.183992] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf91be69-0115-47d1-b6e9-23f54b79cb00 is going to be updated. [ 930.208089] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.208089] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.208089] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.208089] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.208089] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.208551] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf91be69-0115-47d1-b6e9-23f54b79cb00" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.594378] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.594590] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.594590] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.594808] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.594900] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.594999] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c is going to be updated. [ 930.628530] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.628747] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.628800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.629081] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.629252] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.640248] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c in Status: IN_PROGRESS for 2s [ 931.298226] env[66834]: INFO networking_nsxv3.common.synchronization [req-17b212c6-f401-4a9f-b7dd-ffdf41254979 req-8b50d09c-fb08-4e05-a368-1c0c466c1e73 tempest-AttachInterfacesV270Test-2038816931 tempest-AttachInterfacesV270Test-2038816931-project-member] Enqueued Resource ID: d46470ac-aa4d-4eff-9d79-fb152af42f68 with Priority: HIGHEST for action security_group_members [ 931.298801] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46470ac-aa4d-4eff-9d79-fb152af42f68 with Priority: HIGHEST for action security_group_members [ 931.299165] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46470ac-aa4d-4eff-9d79-fb152af42f68 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.299296] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.299359] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.299703] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.299880] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.300010] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.300079] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.300283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.300374] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.300933] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d46470ac-aa4d-4eff-9d79-fb152af42f68',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.604014] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 931.604283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.604511] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.604779] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.605120] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.605120] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.605237] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.605395] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.605478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.605576] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.802548] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.802773] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.802773] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.803103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.803164] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.803437] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.803562] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.803623] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.803791] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.803869] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.803961] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46470ac-aa4d-4eff-9d79-fb152af42f68 is going to be updated. [ 931.859494] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.859637] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.859711] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.859923] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.860089] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.874162] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46470ac-aa4d-4eff-9d79-fb152af42f68 in Status: IN_PROGRESS for 2s [ 932.109877] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.611810] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.650205] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c in Status: IN_PROGRESS for 4s [ 933.114899] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.115167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.115167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.115450] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.115781] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.115781] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be updated. [ 933.146783] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.146783] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.146783] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.146783] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.146783] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.165015] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 933.890260] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46470ac-aa4d-4eff-9d79-fb152af42f68 in Status: SUCCESS [ 933.890587] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46470ac-aa4d-4eff-9d79-fb152af42f68 deletion is rescheduled due to dependency. [ 933.890682] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.661671] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c in Status: SUCCESS [ 934.661889] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.662077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.662310] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.662522] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.662630] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.662690] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.662844] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.662924] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.663026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.663118] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.165916] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.166284] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.166284] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.166479] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.166665] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.166778] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.166843] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.167040] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.167276] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.167346] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.167495] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.167625] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.167735] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.167877] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.168110] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.168351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.168577] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.168650] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.168683] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.168771] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.169139] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.180883] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 935.181302] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.181615] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.181832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.182081] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.182169] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.182202] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.182349] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.182524] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.182524] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.182623] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.672610] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c: rpc.has_security_group_logging(os_id): False [ 935.684496] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.684659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.684730] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.684949] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.685133] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.685240] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.685306] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.685457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.685545] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.685631] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.685774] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.686396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.686396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.686396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.686562] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.686624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.686672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.686815] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.686892] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.686976] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.687080] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.691776] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.691895] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.691974] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.692185] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.692274] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.692457] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.693158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.693158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.693158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.693158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.693158] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.693158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.693158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.693406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.693406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.693563] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.693626] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.693665] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.693803] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.693873] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.693955] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c is going to be updated. [ 935.762047] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.762224] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.762285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.762473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.762628] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.778663] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c in Status: IN_PROGRESS for 2s [ 936.190731] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c88662f-4694-4988-b716-56b85d22f3c9: rpc.has_security_group_logging(os_id): False [ 936.208511] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.208695] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.208770] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.209097] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.209239] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.209571] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.209688] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.209741] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.209916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.210040] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.210277] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.210388] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.210453] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.210700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.210700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.210822] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.212301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.212301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.212301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.212301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.212301] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be updated. [ 936.279314] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.279540] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.279647] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.279939] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.280198] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.299787] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 936.299967] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 936.303645] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 937.760639] env[66834]: INFO networking_nsxv3.common.synchronization [None req-4bbd1fe7-f7e5-4282-8401-4b8d04663359 None None] Enqueued Resource ID: 31f4bdd1-50d0-4599-9937-75fa7c6a40d9 with Priority: HIGHEST for action port [ 937.761982] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31f4bdd1-50d0-4599-9937-75fa7c6a40d9 with Priority: HIGHEST for action port [ 937.763823] env[66834]: INFO networking_nsxv3.common.synchronization [req-c5814f0e-2aee-41ff-8a10-150d2ce6a4b0 req-50494bbe-5194-47f7-9072-a967fa8710ba tempest-ServersNegativeTestJSON-499609681 tempest-ServersNegativeTestJSON-499609681-project-member] Enqueued Resource ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c with Priority: HIGHEST for action security_group_members [ 937.764177] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-31f4bdd1-50d0-4599-9937-75fa7c6a40d9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.764314] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31f4bdd1-50d0-4599-9937-75fa7c6a40d9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.764384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31f4bdd1-50d0-4599-9937-75fa7c6a40d9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.764602] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31f4bdd1-50d0-4599-9937-75fa7c6a40d9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.764687] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31f4bdd1-50d0-4599-9937-75fa7c6a40d9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.766164] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c with Priority: HIGHEST for action security_group_members [ 937.766601] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.766765] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.766802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.766946] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.767339] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.767438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.767545] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.767651] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.767743] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.768415] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.793141] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c in Status: SUCCESS [ 937.793141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.267792] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31f4bdd1-50d0-4599-9937-75fa7c6a40d9 [ 938.267977] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.268142] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.268287] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.268518] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.268607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.268707] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31f4bdd1-50d0-4599-9937-75fa7c6a40d9 already deleted. [ 938.268789] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31f4bdd1-50d0-4599-9937-75fa7c6a40d9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.270121] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.318525] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 938.318525] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.772558] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.137710] env[66834]: INFO networking_nsxv3.common.synchronization [req-20dafcf2-db2a-442f-b6e5-bd9795d07132 req-3e47eee2-88c3-447b-9722-0cbb5af06b4c tempest-ServerActionsTestOtherA-283121819 tempest-ServerActionsTestOtherA-283121819-project-member] Enqueued Resource ID: 673eef00-b174-4a71-a870-466f27b577fd with Priority: HIGHEST for action security_group_members [ 939.138762] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 673eef00-b174-4a71-a870-466f27b577fd with Priority: HIGHEST for action security_group_members [ 939.138906] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-673eef00-b174-4a71-a870-466f27b577fd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.139146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.139242] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.139869] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.139869] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.140016] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.140016] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.141107] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.141107] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.141107] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('673eef00-b174-4a71-a870-466f27b577fd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.275260] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.275668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.276502] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.276502] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.276502] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.276502] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c is going to be updated. [ 939.311028] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.311028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.311028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.311333] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.311333] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.323384] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c in Status: IN_PROGRESS for 2s [ 939.642538] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.642847] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.642847] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.643618] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.643618] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.643618] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.643618] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.643618] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.643618] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.644364] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.644364] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 673eef00-b174-4a71-a870-466f27b577fd is going to be updated. [ 939.691137] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.691384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.691384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.691603] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.691756] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.702666] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 673eef00-b174-4a71-a870-466f27b577fd in Status: IN_PROGRESS for 2s [ 939.960909] env[66834]: INFO networking_nsxv3.common.synchronization [None req-f612bdb6-d599-4ace-bc12-ccf4fb21c1b5 None None] Enqueued Resource ID: 55f496fc-d146-49ad-9be9-32b193bb8eee with Priority: HIGHEST for action port [ 939.961489] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f496fc-d146-49ad-9be9-32b193bb8eee with Priority: HIGHEST for action port [ 939.961794] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-55f496fc-d146-49ad-9be9-32b193bb8eee taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.962070] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55f496fc-d146-49ad-9be9-32b193bb8eee" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.962070] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55f496fc-d146-49ad-9be9-32b193bb8eee" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.963929] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55f496fc-d146-49ad-9be9-32b193bb8eee" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.964030] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55f496fc-d146-49ad-9be9-32b193bb8eee',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.467411] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55f496fc-d146-49ad-9be9-32b193bb8eee [ 940.467663] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.467830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.467897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.468130] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.468274] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.468342] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55f496fc-d146-49ad-9be9-32b193bb8eee already deleted. [ 940.468421] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55f496fc-d146-49ad-9be9-32b193bb8eee" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.344895] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c in Status: SUCCESS [ 941.345729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.715204] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 673eef00-b174-4a71-a870-466f27b577fd in Status: SUCCESS [ 941.715471] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 673eef00-b174-4a71-a870-466f27b577fd deletion is rescheduled due to dependency. [ 941.715554] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.757267] env[66834]: INFO networking_nsxv3.common.synchronization [req-84b960a1-2df2-4c77-a935-d76138f70061 req-42095b6c-1503-4ee6-9b36-389dd2f4df70 tempest-ServersTestJSON-861266990 tempest-ServersTestJSON-861266990-project-member] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 941.757797] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 941.758121] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.758235] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.758307] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.758490] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.758782] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.758980] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.758980] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.759142] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.759227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.759322] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.261497] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.764818] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.267276] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.267438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.267500] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.267745] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.267784] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.267887] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be updated. [ 943.298457] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.298610] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.298650] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.299181] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.299181] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.313545] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 944.908998] env[66834]: INFO networking_nsxv3.common.synchronization [req-ca0c4eab-c019-49da-9bb9-a83e21e6916d req-0241c56d-0004-4a95-8f13-de9529bcc8d2 tempest-DeleteServersTestJSON-1250802255 tempest-DeleteServersTestJSON-1250802255-project-member] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 944.909670] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 944.910198] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.910399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.910474] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.910740] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.910895] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.910995] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.911077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.911219] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.911311] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.911408] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.326580] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 945.326849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.414616] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.414781] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.414824] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.415042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.415135] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.415340] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.415430] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.415543] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.415657] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.415737] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.415815] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be updated. [ 945.451693] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.451693] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.451693] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.452201] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.452201] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.461996] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: IN_PROGRESS for 2s [ 947.473942] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: SUCCESS [ 947.474208] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a deletion is rescheduled due to dependency. [ 947.474367] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.893537] env[66834]: INFO networking_nsxv3.common.synchronization [req-a406b101-a8bd-464c-8b6a-ec107d2de10a req-bc88d4a7-dda9-4ee9-b3a4-0fc231bd2833 tempest-ServersAdminTestJSON-835845617 tempest-ServersAdminTestJSON-835845617-project-member] Enqueued Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_members [ 948.894515] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_members [ 948.894515] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.894515] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.894737] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.894802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.895029] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.895443] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.895443] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.895443] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.895443] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.895443] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.965502] env[66834]: INFO networking_nsxv3.common.synchronization [req-99265df2-82ca-4ad2-810e-7ce276f4b3f2 req-ebe7105e-479a-42ae-b1aa-4c7ea52b7ac1 tempest-ServerDiskConfigTestJSON-362503924 tempest-ServerDiskConfigTestJSON-362503924-project-member] Enqueued Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 948.966243] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 948.966630] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.967033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.967033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.967309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.967671] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.967671] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.967671] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.967878] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.967878] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.968022] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.397302] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.420215] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-98 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.420445] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-98" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.420572] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-98" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.420837] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-98" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.421112] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.421290] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.421478] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.421598] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.421733] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.421933] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 949.422122] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 949.422263] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 949.422345] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 949.422453] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 949.423296] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 949.423296] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 949.443662] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 949.444374] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 949.444526] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 949.446062] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-98" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.446062] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-c0142398-2d40-4183-aabd-5e6ec1d24cff taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.446062] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-c0142398-2d40-4183-aabd-5e6ec1d24cff" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.446062] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-c0142398-2d40-4183-aabd-5e6ec1d24cff" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.446332] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-c0142398-2d40-4183-aabd-5e6ec1d24cff" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.446332] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0142398-2d40-4183-aabd-5e6ec1d24cff',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.469766] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.469915] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.469991] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.470232] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.470355] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.470558] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.470660] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.470723] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.470883] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.470962] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.471063] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7963c125-23b5-45fd-8158-f6470d12949e is going to be updated. [ 949.500730] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.500730] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.500730] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.500951] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.500951] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.512050] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: IN_PROGRESS for 2s [ 949.899947] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.948969] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.949233] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.949361] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.949638] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.949786] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.949948] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port c0142398-2d40-4183-aabd-5e6ec1d24cff not found, creating... [ 949.950362] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.950496] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.950637] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.950914] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.951083] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.951507] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.951739] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.951991] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.952267] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.952502] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.953112] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: c0142398-2d40-4183-aabd-5e6ec1d24cff is going to be created. [ 949.979289] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.979525] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.979688] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.979941] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.980204] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.980599] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-c0142398-2d40-4183-aabd-5e6ec1d24cff" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.402333] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.402500] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.402626] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.402847] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.402938] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.403048] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9276c5a5-af43-4c6e-899f-c34039400160 is going to be updated. [ 950.444627] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.444772] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.444809] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.445067] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.445227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.458750] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: IN_PROGRESS for 2s [ 951.151777] env[66834]: INFO networking_nsxv3.common.synchronization [req-99265df2-82ca-4ad2-810e-7ce276f4b3f2 req-5c94218a-7f56-4f55-9b74-16b66eef5a3b service nova] Enqueued Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_rules [ 951.152095] env[66834]: INFO networking_nsxv3.common.synchronization [req-99265df2-82ca-4ad2-810e-7ce276f4b3f2 req-5c94218a-7f56-4f55-9b74-16b66eef5a3b service nova] Enqueued Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 951.152207] env[66834]: INFO networking_nsxv3.common.synchronization [req-99265df2-82ca-4ad2-810e-7ce276f4b3f2 req-5c94218a-7f56-4f55-9b74-16b66eef5a3b service nova] Enqueued Resource ID: c0142398-2d40-4183-aabd-5e6ec1d24cff with Priority: HIGHEST for action port [ 951.152805] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_rules [ 951.152936] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 951.153020] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0142398-2d40-4183-aabd-5e6ec1d24cff with Priority: HIGHEST for action port [ 951.153444] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.153569] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.153635] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.153831] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.153949] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.156956] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.157436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.157709] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0142398-2d40-4183-aabd-5e6ec1d24cff taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.157981] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0142398-2d40-4183-aabd-5e6ec1d24cff" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.158114] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0142398-2d40-4183-aabd-5e6ec1d24cff" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.158684] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0142398-2d40-4183-aabd-5e6ec1d24cff" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.158684] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0142398-2d40-4183-aabd-5e6ec1d24cff',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.523059] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: SUCCESS [ 951.523257] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7963c125-23b5-45fd-8158-f6470d12949e deletion is rescheduled due to dependency. [ 951.523371] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.523533] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.523742] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.526281] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.526281] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.526281] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.526281] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.526281] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.526281] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.567674] env[66834]: INFO networking_nsxv3.common.synchronization [req-27400bc6-04b8-40bf-94a5-e45354c430aa req-999ca7a9-de27-4302-afc2-10aff96a5cc5 tempest-ImagesTestJSON-910661197 tempest-ImagesTestJSON-910661197-project-member] Enqueued Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 951.568211] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 951.568634] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.568763] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.568822] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.569040] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.569222] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.569368] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.569424] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.569547] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.569633] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.569725] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.658257] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.658257] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.660888] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0142398-2d40-4183-aabd-5e6ec1d24cff with status ACTIVE [ 951.660888] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.661064] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.661064] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.662372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.662372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.662372] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.662372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.662372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.662372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.662372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.662372] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.662372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.662372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.662372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.663260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.663260] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0142398-2d40-4183-aabd-5e6ec1d24cff is going to be updated. [ 951.685540] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.685751] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.685751] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.686380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.686380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.686380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0142398-2d40-4183-aabd-5e6ec1d24cff" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.891426] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-793 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.891676] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-793" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.891728] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-793" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.891998] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-793" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.892543] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.892762] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.892882] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.893113] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.893254] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.893458] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.893572] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 951.893679] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 951.893786] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 951.893896] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.894013] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 951.894139] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 951.935694] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 951.936130] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.042 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 951.936262] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 951.936513] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-793" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.936905] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-40f239ba-9169-410e-b455-469d9906e6bc taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.937145] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-40f239ba-9169-410e-b455-469d9906e6bc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.937319] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-40f239ba-9169-410e-b455-469d9906e6bc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.937722] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-40f239ba-9169-410e-b455-469d9906e6bc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.937867] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40f239ba-9169-410e-b455-469d9906e6bc',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.027331] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.072906] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.073124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.073124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.073390] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.073508] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.073789] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.073906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.073993] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.074196] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.074306] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.074412] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 is going to be updated. [ 952.112316] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.112508] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.112549] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.112736] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.112879] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.122386] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: IN_PROGRESS for 2s [ 952.441048] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.441444] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.441696] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.441905] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.442077] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.443782] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 40f239ba-9169-410e-b455-469d9906e6bc not found, creating... [ 952.443782] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.443782] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.443782] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.443782] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.443782] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.444116] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.444409] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.444613] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.444860] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.445339] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.445432] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 40f239ba-9169-410e-b455-469d9906e6bc is going to be created. [ 952.469035] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.469035] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.469204] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.469368] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.470412] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.470412] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-40f239ba-9169-410e-b455-469d9906e6bc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.471401] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: SUCCESS [ 952.472028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.530099] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.032768] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.032931] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.033010] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.033245] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.033351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.033463] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7963c125-23b5-45fd-8158-f6470d12949e is going to be updated. [ 953.077009] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.077245] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.077245] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.077466] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.077594] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.095187] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: IN_PROGRESS for 2s [ 953.185915] env[66834]: INFO networking_nsxv3.common.synchronization [req-27400bc6-04b8-40bf-94a5-e45354c430aa req-2e661998-5968-4d21-96af-ffd57bccc285 service nova] Enqueued Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_rules [ 953.185915] env[66834]: INFO networking_nsxv3.common.synchronization [req-27400bc6-04b8-40bf-94a5-e45354c430aa req-2e661998-5968-4d21-96af-ffd57bccc285 service nova] Enqueued Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 953.186216] env[66834]: INFO networking_nsxv3.common.synchronization [req-27400bc6-04b8-40bf-94a5-e45354c430aa req-2e661998-5968-4d21-96af-ffd57bccc285 service nova] Enqueued Resource ID: 40f239ba-9169-410e-b455-469d9906e6bc with Priority: HIGHEST for action port [ 953.186886] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_rules [ 953.187260] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 953.187404] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40f239ba-9169-410e-b455-469d9906e6bc with Priority: HIGHEST for action port [ 953.188385] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.188722] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.188800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.189577] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.189577] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.191053] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.191053] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.191053] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-40f239ba-9169-410e-b455-469d9906e6bc taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.191053] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40f239ba-9169-410e-b455-469d9906e6bc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.191053] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40f239ba-9169-410e-b455-469d9906e6bc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.191053] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40f239ba-9169-410e-b455-469d9906e6bc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.191314] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40f239ba-9169-410e-b455-469d9906e6bc',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.694209] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.694209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.694209] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40f239ba-9169-410e-b455-469d9906e6bc with status ACTIVE [ 953.694209] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.694209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.694209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.694209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.694209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.694874] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.694874] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.694874] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.694874] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.694874] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.694874] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.696864] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.696864] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.696864] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.696864] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.696864] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40f239ba-9169-410e-b455-469d9906e6bc is going to be updated. [ 953.732209] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.732209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.732209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.732415] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.733054] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.733054] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40f239ba-9169-410e-b455-469d9906e6bc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.133831] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: SUCCESS [ 954.134124] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 deletion is rescheduled due to dependency. [ 954.134227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.134452] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.134770] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.135050] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.135232] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.135298] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.135539] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.135699] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.135854] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.638156] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.108928] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: SUCCESS [ 955.108928] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.109664] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.109664] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.109764] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.109822] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.109988] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.110175] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.110351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.110697] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.111481] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.139995] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.616266] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.616343] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.616384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.616614] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.616783] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.616921] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.616957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.617105] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.617191] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.617279] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.617426] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.617520] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.617578] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.617718] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.617851] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.617939] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.617998] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.618151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.618225] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.618318] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.618431] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.643314] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.643476] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.643476] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.643673] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.643761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.644521] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 is going to be updated. [ 955.676788] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.676871] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.676958] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.677245] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.677367] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.688016] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: IN_PROGRESS for 2s [ 956.122041] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7963c125-23b5-45fd-8158-f6470d12949e: rpc.has_security_group_logging(os_id): False [ 956.140784] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.140972] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.141023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.141265] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.141359] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.141620] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.141729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.141778] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.141940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.142026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.142221] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.142317] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.142378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.142524] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.142599] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.142808] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.142903] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.142962] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.143119] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.143206] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.143288] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7963c125-23b5-45fd-8158-f6470d12949e is going to be updated. [ 956.211625] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.211625] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.211625] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.211625] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.211909] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.227314] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: IN_PROGRESS for 2s [ 957.699813] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: SUCCESS [ 957.700184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.700259] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.700521] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.700724] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.700861] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.700944] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.701092] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.701195] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.701278] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.701353] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.188919] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 958.189037] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 958.208171] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.208171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.208171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.208171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.208171] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.208171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.208171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.208171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.208171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.208171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.208171] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.208171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.208171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.208171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.208171] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.208171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.208872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.208872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.208872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.208872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.208872] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.228548] env[66834]: INFO networking_nsxv3.common.synchronization [req-95121703-ee30-4b37-9ae1-02fddd66b549 req-69b0c604-5b4e-44aa-a54e-4a325e8f2a07 tempest-ServersTestBootFromVolume-1337405367 tempest-ServersTestBootFromVolume-1337405367-project-member] Enqueued Resource ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 with Priority: HIGHEST for action security_group_members [ 958.229886] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 with Priority: HIGHEST for action security_group_members [ 958.231482] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c5efb50-1e08-43fc-a6ab-e2d1db110262 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.231482] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.231482] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.231482] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.231724] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.231724] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.231724] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.231849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.231975] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.232400] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c5efb50-1e08-43fc-a6ab-e2d1db110262',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.244947] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: SUCCESS [ 958.245165] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.584168] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-248 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.584168] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-248" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.584350] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-248" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.584841] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-248" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.584920] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.585035] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.585150] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.585352] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.585487] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.585687] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 958.586410] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 958.586410] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 958.586410] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 958.586410] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 958.586410] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 958.586410] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 958.605429] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 958.605586] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 958.605586] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 958.605807] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-248" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.606139] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-42d0f195-bcec-42a7-9cc4-1c5f2f246297 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.606990] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-42d0f195-bcec-42a7-9cc4-1c5f2f246297" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.606990] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-42d0f195-bcec-42a7-9cc4-1c5f2f246297" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.606990] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-42d0f195-bcec-42a7-9cc4-1c5f2f246297" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.606990] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42d0f195-bcec-42a7-9cc4-1c5f2f246297',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.714157] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 599d582a-c0d7-4df7-a1fe-3e63412d8939: rpc.has_security_group_logging(os_id): False [ 958.734897] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.735854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.735854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.735854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.735854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.735854] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.735854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.735854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.736103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.736103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.736272] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.736390] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.736449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.736616] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.736685] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.736862] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.736965] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.737082] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.737253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.737325] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.737407] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 is going to be updated. [ 958.739910] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.739910] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.739910] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.739910] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.739910] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.739910] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.739910] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.739910] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.739910] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.739910] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.739910] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 already deleted. [ 958.739910] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.808982] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.809316] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.809395] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.809660] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.809853] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.826807] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: IN_PROGRESS for 2s [ 959.111022] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.111958] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.111958] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.111958] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.112190] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.112235] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 42d0f195-bcec-42a7-9cc4-1c5f2f246297 not found, creating... [ 959.112619] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.112844] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.113034] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.113343] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.113565] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.113958] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.114169] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.114372] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.114718] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.114873] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.115034] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 42d0f195-bcec-42a7-9cc4-1c5f2f246297 is going to be created. [ 959.139158] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.139403] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.139493] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.139778] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.140076] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.140314] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-42d0f195-bcec-42a7-9cc4-1c5f2f246297" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.926681] env[66834]: INFO networking_nsxv3.common.synchronization [req-95121703-ee30-4b37-9ae1-02fddd66b549 req-5d3d2cdd-ec78-41dc-8216-0a6f77c326b8 service nova] Enqueued Resource ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 with Priority: HIGHEST for action security_group_rules [ 959.926941] env[66834]: INFO networking_nsxv3.common.synchronization [req-95121703-ee30-4b37-9ae1-02fddd66b549 req-5d3d2cdd-ec78-41dc-8216-0a6f77c326b8 service nova] Enqueued Resource ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 with Priority: HIGHEST for action security_group_members [ 959.927020] env[66834]: INFO networking_nsxv3.common.synchronization [req-95121703-ee30-4b37-9ae1-02fddd66b549 req-5d3d2cdd-ec78-41dc-8216-0a6f77c326b8 service nova] Enqueued Resource ID: 42d0f195-bcec-42a7-9cc4-1c5f2f246297 with Priority: HIGHEST for action port [ 959.927552] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 with Priority: HIGHEST for action security_group_rules [ 959.927653] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 with Priority: HIGHEST for action security_group_members [ 959.927753] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d0f195-bcec-42a7-9cc4-1c5f2f246297 with Priority: HIGHEST for action port [ 959.930170] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c5efb50-1e08-43fc-a6ab-e2d1db110262 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.930301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.930389] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.931479] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.931602] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c5efb50-1e08-43fc-a6ab-e2d1db110262',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.932950] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c5efb50-1e08-43fc-a6ab-e2d1db110262 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.938022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.938022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.938022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.938022] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.938022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.938022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.938022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.938022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.938022] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c5efb50-1e08-43fc-a6ab-e2d1db110262',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.938022] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-42d0f195-bcec-42a7-9cc4-1c5f2f246297 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.938022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42d0f195-bcec-42a7-9cc4-1c5f2f246297" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.938022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42d0f195-bcec-42a7-9cc4-1c5f2f246297" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.938022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42d0f195-bcec-42a7-9cc4-1c5f2f246297" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.938022] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42d0f195-bcec-42a7-9cc4-1c5f2f246297',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.440666] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c5efb50-1e08-43fc-a6ab-e2d1db110262 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.441582] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.441582] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c5efb50-1e08-43fc-a6ab-e2d1db110262',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.442208] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42d0f195-bcec-42a7-9cc4-1c5f2f246297 with status ACTIVE [ 960.442791] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.442976] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.443108] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.443403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.443836] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.443836] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.443836] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.443981] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.444770] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.444770] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.444770] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.446029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.446029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.446199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.446346] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.446508] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42d0f195-bcec-42a7-9cc4-1c5f2f246297 is going to be updated. [ 960.471862] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.472097] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.472204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.472508] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.472804] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.473008] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42d0f195-bcec-42a7-9cc4-1c5f2f246297" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.699158] env[66834]: INFO networking_nsxv3.common.synchronization [None req-59cfa271-6956-4fd4-8a9d-c37246dcbac1 None None] Enqueued Resource ID: 81fd90fa-6f98-46a7-905d-fc3d82a87abd with Priority: HIGHEST for action port [ 960.699907] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81fd90fa-6f98-46a7-905d-fc3d82a87abd with Priority: HIGHEST for action port [ 960.700368] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-81fd90fa-6f98-46a7-905d-fc3d82a87abd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.700530] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81fd90fa-6f98-46a7-905d-fc3d82a87abd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.700632] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81fd90fa-6f98-46a7-905d-fc3d82a87abd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.701021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81fd90fa-6f98-46a7-905d-fc3d82a87abd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.701235] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81fd90fa-6f98-46a7-905d-fc3d82a87abd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.841967] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: SUCCESS [ 960.842400] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.923326] env[66834]: INFO networking_nsxv3.common.synchronization [req-33222458-c773-4e90-9109-e5c7fb64ff89 req-ce497c17-61ea-41d3-9108-60707c4ff756 tempest-AttachInterfacesTestJSON-77868371 tempest-AttachInterfacesTestJSON-77868371-project-member] Enqueued Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 960.924021] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 960.927214] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.927514] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.927514] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.927698] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.927903] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.928275] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.928275] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.928521] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.928521] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.928521] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.950109] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c5efb50-1e08-43fc-a6ab-e2d1db110262',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.204114] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 81fd90fa-6f98-46a7-905d-fc3d82a87abd [ 961.204384] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.204504] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.204573] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.204804] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.204882] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.204977] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:81fd90fa-6f98-46a7-905d-fc3d82a87abd already deleted. [ 961.205062] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81fd90fa-6f98-46a7-905d-fc3d82a87abd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.295600] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-106 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.295791] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.295914] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.296990] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.296990] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.296990] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.296990] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.296990] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.297264] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.297264] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 961.297334] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 961.297438] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 961.298765] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 961.298765] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 961.298765] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 961.298765] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 961.319817] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 961.319817] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 961.319817] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 961.319817] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.320065] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-a1de8302-5dfb-4f99-b6e7-a1da50323da9 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.320134] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-a1de8302-5dfb-4f99-b6e7-a1da50323da9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.320243] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-a1de8302-5dfb-4f99-b6e7-a1da50323da9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.320618] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-a1de8302-5dfb-4f99-b6e7-a1da50323da9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.320760] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1de8302-5dfb-4f99-b6e7-a1da50323da9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.431886] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.433026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.433026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.433026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.433026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.433026] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.433026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.433026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.433340] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.433340] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.433340] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2989937c-6050-493e-a1d8-79a52d9b6132 is going to be updated. [ 961.454667] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.454865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.454937] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.455163] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.455250] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.455348] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 is going to be created. [ 961.466938] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.466938] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.466938] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.467162] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.467252] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.477139] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: IN_PROGRESS for 2s [ 961.482869] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.483096] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.483534] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.483534] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.483534] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.494111] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 in Status: UNINITIALIZED for 2s [ 961.823048] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.823293] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.823419] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.823714] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.823860] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.824020] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port a1de8302-5dfb-4f99-b6e7-a1da50323da9 not found, creating... [ 961.824281] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.824438] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.824557] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.824780] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.824917] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.825205] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.825361] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.825488] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.825732] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.825866] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.826011] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: a1de8302-5dfb-4f99-b6e7-a1da50323da9 is going to be created. [ 961.860631] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.860871] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.860994] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.861292] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.861636] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.861887] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-a1de8302-5dfb-4f99-b6e7-a1da50323da9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.627374] env[66834]: INFO networking_nsxv3.common.synchronization [req-33222458-c773-4e90-9109-e5c7fb64ff89 req-efbcdb38-ea60-47a0-8132-8fda6cc34225 service nova] Enqueued Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_rules [ 962.627374] env[66834]: INFO networking_nsxv3.common.synchronization [req-33222458-c773-4e90-9109-e5c7fb64ff89 req-efbcdb38-ea60-47a0-8132-8fda6cc34225 service nova] Enqueued Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 962.627767] env[66834]: INFO networking_nsxv3.common.synchronization [req-33222458-c773-4e90-9109-e5c7fb64ff89 req-efbcdb38-ea60-47a0-8132-8fda6cc34225 service nova] Enqueued Resource ID: a1de8302-5dfb-4f99-b6e7-a1da50323da9 with Priority: HIGHEST for action port [ 962.628050] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_rules [ 962.628198] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 962.628319] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1de8302-5dfb-4f99-b6e7-a1da50323da9 with Priority: HIGHEST for action port [ 962.629269] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.629372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.629416] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.629611] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.629693] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.630761] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.630878] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.631157] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1de8302-5dfb-4f99-b6e7-a1da50323da9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.631316] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1de8302-5dfb-4f99-b6e7-a1da50323da9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.631428] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1de8302-5dfb-4f99-b6e7-a1da50323da9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.631716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1de8302-5dfb-4f99-b6e7-a1da50323da9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.631849] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1de8302-5dfb-4f99-b6e7-a1da50323da9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.804772] env[66834]: INFO networking_nsxv3.common.synchronization [None req-9d29cdbb-f492-4f7d-be03-9e8bc56027ea None None] Enqueued Resource ID: 925f6ede-4194-4edb-981e-801c8a97d507 with Priority: HIGHEST for action port [ 962.805458] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 925f6ede-4194-4edb-981e-801c8a97d507 with Priority: HIGHEST for action port [ 962.805873] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-925f6ede-4194-4edb-981e-801c8a97d507 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.805981] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-925f6ede-4194-4edb-981e-801c8a97d507" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.806081] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-925f6ede-4194-4edb-981e-801c8a97d507" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.806380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-925f6ede-4194-4edb-981e-801c8a97d507" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.806494] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('925f6ede-4194-4edb-981e-801c8a97d507',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.135866] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.136086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.138696] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1de8302-5dfb-4f99-b6e7-a1da50323da9 with status ACTIVE [ 963.139037] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.139259] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.139393] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.139988] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.140083] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.140342] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.140607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.140691] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.140884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.140975] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.141227] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.141307] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.141375] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.141541] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.141621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.141712] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1de8302-5dfb-4f99-b6e7-a1da50323da9 is going to be updated. [ 963.168394] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.168572] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.168634] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.168815] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.168950] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.169157] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1de8302-5dfb-4f99-b6e7-a1da50323da9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.308615] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 925f6ede-4194-4edb-981e-801c8a97d507 [ 963.308852] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.308983] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.309072] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.309305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.309386] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.309482] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:925f6ede-4194-4edb-981e-801c8a97d507 already deleted. [ 963.309564] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-925f6ede-4194-4edb-981e-801c8a97d507" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.494160] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: SUCCESS [ 963.494160] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2989937c-6050-493e-a1d8-79a52d9b6132 deletion is rescheduled due to dependency. [ 963.494160] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.494160] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.494160] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.494160] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.494160] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.494160] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.494160] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.494160] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.494160] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.506400] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 in Status: SUCCESS [ 963.506626] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.506800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.507132] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.507256] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.507340] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.507452] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.508409] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.508549] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.508644] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.508762] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c5efb50-1e08-43fc-a6ab-e2d1db110262',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.997671] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.011163] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c5efb50-1e08-43fc-a6ab-e2d1db110262',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.502949] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.514081] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c5efb50-1e08-43fc-a6ab-e2d1db110262: rpc.has_security_group_logging(os_id): False [ 964.533466] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.533787] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.533787] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.533913] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.533967] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.534247] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.534403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.534485] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.534701] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.534789] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.534883] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 is going to be created. [ 964.615746] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.616060] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.616060] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.616371] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.616599] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.632553] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 in Status: IN_PROGRESS for 2s [ 965.008503] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.008883] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.008883] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.008978] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.009091] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.009190] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2989937c-6050-493e-a1d8-79a52d9b6132 is going to be updated. [ 965.043795] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.044042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.044042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.044269] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.044378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.059306] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: IN_PROGRESS for 2s [ 966.645249] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 in Status: SUCCESS [ 966.645560] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.073897] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: SUCCESS [ 967.074446] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.074446] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.074684] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.074923] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.075019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.075217] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.075279] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.075318] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.075406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.075499] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.578445] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.578639] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.578761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.579222] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.579407] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.579523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.579582] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.579787] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.579902] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.579996] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.580181] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.580268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.580325] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.580537] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.580796] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.580916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.580985] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.581315] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.581394] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.581531] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.581614] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.806468] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 967.806880] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 968.085669] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2989937c-6050-493e-a1d8-79a52d9b6132: rpc.has_security_group_logging(os_id): False [ 968.112055] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.112055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.112055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.112282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.112282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.112766] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.112766] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.112766] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.113849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.113849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.113849] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.113849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.113849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.113849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.113849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.113849] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.114141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.114141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.114141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.114224] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.114279] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2989937c-6050-493e-a1d8-79a52d9b6132 is going to be updated. [ 968.189145] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.189300] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.189371] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.189559] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.189704] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.205755] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: IN_PROGRESS for 2s [ 969.441872] env[66834]: INFO networking_nsxv3.common.synchronization [None req-c7686f02-cc87-4667-a606-5bdbf60f574f tempest-AttachInterfacesTestJSON-77868371 tempest-AttachInterfacesTestJSON-77868371-project-member] Enqueued Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 969.442537] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 969.442863] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.442989] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.444154] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.444381] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.445570] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.445570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.445570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.445570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.445570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.445570] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.823805] env[66834]: INFO networking_nsxv3.common.synchronization [None req-1eb657b9-855f-4733-8fc2-f5315a98438b None None] Enqueued Resource ID: c0fb3444-5ed3-478e-acee-3985cddc0886 with Priority: HIGHEST for action port [ 969.824954] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fb3444-5ed3-478e-acee-3985cddc0886 with Priority: HIGHEST for action port [ 969.825733] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0fb3444-5ed3-478e-acee-3985cddc0886 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.826149] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0fb3444-5ed3-478e-acee-3985cddc0886" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.826423] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0fb3444-5ed3-478e-acee-3985cddc0886" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.826937] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0fb3444-5ed3-478e-acee-3985cddc0886" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.827142] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0fb3444-5ed3-478e-acee-3985cddc0886',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.949235] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.220135] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: SUCCESS [ 970.220373] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.329704] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c0fb3444-5ed3-478e-acee-3985cddc0886 [ 970.330019] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.330208] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.330309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.330619] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.330715] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.330817] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c0fb3444-5ed3-478e-acee-3985cddc0886 already deleted. [ 970.330964] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0fb3444-5ed3-478e-acee-3985cddc0886" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.454386] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.741507] env[66834]: INFO networking_nsxv3.common.synchronization [req-a446f16b-1a32-4aeb-9e43-e0956c9198fc req-eb50237e-de3f-46ca-a2f3-a6f55b21c010 tempest-ServerActionsTestOtherB-2089780499 tempest-ServerActionsTestOtherB-2089780499-project-member] Enqueued Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_members [ 970.741507] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_members [ 970.741829] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06251551-417e-4f8a-9412-fdb5036f57fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.741953] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.742040] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.742244] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.743247] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.743477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.743548] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.743689] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.743771] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.743870] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.957554] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.957726] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.957770] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.957990] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.958094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.958190] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2989937c-6050-493e-a1d8-79a52d9b6132 is going to be updated. [ 970.991523] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.991679] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.991733] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.995326] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.995326] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.003739] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: IN_PROGRESS for 2s [ 971.136471] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.136836] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-608" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.137035] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-608" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.137373] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-608" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.138899] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.138899] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.139281] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.139281] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.139654] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.139770] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 971.139928] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 971.140089] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 971.140247] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 971.140433] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 971.140561] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 971.140742] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 971.164280] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 971.164450] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 971.164570] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 971.164748] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-608" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.165128] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-d77de370-03fb-4100-93c0-ef2270bafde2 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.165707] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-d77de370-03fb-4100-93c0-ef2270bafde2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.165707] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-d77de370-03fb-4100-93c0-ef2270bafde2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.165971] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-d77de370-03fb-4100-93c0-ef2270bafde2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.165971] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d77de370-03fb-4100-93c0-ef2270bafde2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.245761] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.245919] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.245919] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.246221] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.246295] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.246520] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.246623] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.246676] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.247053] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.247053] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.247053] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06251551-417e-4f8a-9412-fdb5036f57fe is going to be updated. [ 971.276355] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.277247] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.277247] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.277470] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.277620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.287271] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: IN_PROGRESS for 2s [ 971.672024] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.672024] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.672024] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.672024] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.672024] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.672024] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port d77de370-03fb-4100-93c0-ef2270bafde2 not found, creating... [ 971.672024] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.672024] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.672024] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.672024] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.672024] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.672785] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.672785] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.672785] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.672785] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.672785] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.672938] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: d77de370-03fb-4100-93c0-ef2270bafde2 is going to be created. [ 971.704899] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.705147] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.705248] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.705503] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.705729] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.705947] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-d77de370-03fb-4100-93c0-ef2270bafde2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.157626] env[66834]: INFO networking_nsxv3.common.synchronization [None req-dad771b9-e8cd-42c8-b493-e2c90c8bf8df None None] Enqueued Resource ID: 45e353ae-83ab-49cc-8d96-6e797d126ab6 with Priority: HIGHEST for action port [ 972.158225] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45e353ae-83ab-49cc-8d96-6e797d126ab6 with Priority: HIGHEST for action port [ 972.158596] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-45e353ae-83ab-49cc-8d96-6e797d126ab6 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.158742] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45e353ae-83ab-49cc-8d96-6e797d126ab6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.158812] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45e353ae-83ab-49cc-8d96-6e797d126ab6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.159111] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45e353ae-83ab-49cc-8d96-6e797d126ab6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.159198] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45e353ae-83ab-49cc-8d96-6e797d126ab6',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.246757] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-106 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.246980] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.247094] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.247352] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.247598] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.247750] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.247867] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.248254] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.248504] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.248753] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 972.248900] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 972.249054] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 972.249226] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 972.249331] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 972.249460] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 972.249619] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 972.268506] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 972.268713] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 972.268908] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 972.269118] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.269462] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-1e221484-e17f-4bfc-a749-3e37bd368fb2 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.269679] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-1e221484-e17f-4bfc-a749-3e37bd368fb2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.269926] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-1e221484-e17f-4bfc-a749-3e37bd368fb2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.270196] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-1e221484-e17f-4bfc-a749-3e37bd368fb2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.270378] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e221484-e17f-4bfc-a749-3e37bd368fb2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.407426] env[66834]: INFO networking_nsxv3.common.synchronization [req-a446f16b-1a32-4aeb-9e43-e0956c9198fc req-4ad630e8-2de6-47f0-a5c5-543d36acec35 service nova] Enqueued Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_rules [ 972.409198] env[66834]: INFO networking_nsxv3.common.synchronization [req-a446f16b-1a32-4aeb-9e43-e0956c9198fc req-4ad630e8-2de6-47f0-a5c5-543d36acec35 service nova] Enqueued Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_members [ 972.409363] env[66834]: INFO networking_nsxv3.common.synchronization [req-a446f16b-1a32-4aeb-9e43-e0956c9198fc req-4ad630e8-2de6-47f0-a5c5-543d36acec35 service nova] Enqueued Resource ID: d77de370-03fb-4100-93c0-ef2270bafde2 with Priority: HIGHEST for action port [ 972.409972] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_rules [ 972.410130] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_members [ 972.410238] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d77de370-03fb-4100-93c0-ef2270bafde2 with Priority: HIGHEST for action port [ 972.410726] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06251551-417e-4f8a-9412-fdb5036f57fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.410871] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.413494] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.413494] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.413494] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.413494] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06251551-417e-4f8a-9412-fdb5036f57fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.413494] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.413494] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-d77de370-03fb-4100-93c0-ef2270bafde2 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.413494] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d77de370-03fb-4100-93c0-ef2270bafde2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.413494] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d77de370-03fb-4100-93c0-ef2270bafde2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.413494] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d77de370-03fb-4100-93c0-ef2270bafde2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.413494] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d77de370-03fb-4100-93c0-ef2270bafde2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.661358] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 45e353ae-83ab-49cc-8d96-6e797d126ab6 [ 972.661726] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.661897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.661994] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.662273] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.662391] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.662506] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:45e353ae-83ab-49cc-8d96-6e797d126ab6 already deleted. [ 972.662608] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45e353ae-83ab-49cc-8d96-6e797d126ab6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.773365] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.773712] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.773712] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.773993] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.774159] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.774314] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 1e221484-e17f-4bfc-a749-3e37bd368fb2 not found, creating... [ 972.774569] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.774730] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.774863] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.775082] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.775248] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.775549] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.775706] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.775821] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.776036] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.776170] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.776304] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 1e221484-e17f-4bfc-a749-3e37bd368fb2 is going to be created. [ 972.797558] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.797558] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.797955] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.797955] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.798182] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.798437] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-1e221484-e17f-4bfc-a749-3e37bd368fb2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.916119] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06251551-417e-4f8a-9412-fdb5036f57fe taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.916119] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.916119] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d77de370-03fb-4100-93c0-ef2270bafde2 with status ACTIVE [ 972.916392] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.916392] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.916392] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.916619] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.916619] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.916782] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.916899] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.916941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.917085] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.917159] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.917335] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.917428] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.917485] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.917623] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.917693] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.917777] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d77de370-03fb-4100-93c0-ef2270bafde2 is going to be updated. [ 972.960718] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.960926] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.960926] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.961138] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.961274] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.961434] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d77de370-03fb-4100-93c0-ef2270bafde2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.017192] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: SUCCESS [ 973.017411] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.297380] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: SUCCESS [ 973.297571] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06251551-417e-4f8a-9412-fdb5036f57fe deletion is rescheduled due to dependency. [ 973.297688] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.297851] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.298084] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.298266] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.298484] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.298484] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.298622] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.298693] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.298786] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.518999] env[66834]: INFO networking_nsxv3.common.synchronization [req-60150108-7f71-45da-8d7d-23dd9e699875 req-95f235ad-20a1-4700-939f-741b9cf6919b service nova] Enqueued Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_rules [ 973.519211] env[66834]: INFO networking_nsxv3.common.synchronization [req-60150108-7f71-45da-8d7d-23dd9e699875 req-95f235ad-20a1-4700-939f-741b9cf6919b service nova] Enqueued Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 973.519344] env[66834]: INFO networking_nsxv3.common.synchronization [req-60150108-7f71-45da-8d7d-23dd9e699875 req-95f235ad-20a1-4700-939f-741b9cf6919b service nova] Enqueued Resource ID: 1e221484-e17f-4bfc-a749-3e37bd368fb2 with Priority: HIGHEST for action port [ 973.519813] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_rules [ 973.519957] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 973.520210] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e221484-e17f-4bfc-a749-3e37bd368fb2 with Priority: HIGHEST for action port [ 973.520566] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.520644] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.520709] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.520926] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.520987] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.521978] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.523120] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.523218] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.523422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.523683] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.523683] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.523763] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.526799] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.526799] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.526799] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.527874] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e221484-e17f-4bfc-a749-3e37bd368fb2 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.528302] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e221484-e17f-4bfc-a749-3e37bd368fb2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.528576] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e221484-e17f-4bfc-a749-3e37bd368fb2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.528921] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e221484-e17f-4bfc-a749-3e37bd368fb2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.529078] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e221484-e17f-4bfc-a749-3e37bd368fb2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.801889] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.031606] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.031606] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.031827] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.032650] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e221484-e17f-4bfc-a749-3e37bd368fb2 with status ACTIVE [ 974.032833] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.032949] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.033523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.033523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.033523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.033523] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.033727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.033727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.033786] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.033815] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.033986] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.034115] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.034158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.034284] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.034356] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.034439] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e221484-e17f-4bfc-a749-3e37bd368fb2 is going to be updated. [ 974.199068] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.199289] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.199289] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.199478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.199624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.199760] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e221484-e17f-4bfc-a749-3e37bd368fb2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.305854] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.536469] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.808797] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.809106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.809106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.809350] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.809483] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.809604] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06251551-417e-4f8a-9412-fdb5036f57fe is going to be updated. [ 974.841536] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.841729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.841729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.841938] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.842342] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.852030] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: IN_PROGRESS for 2s [ 975.040785] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.040785] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.040785] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.040785] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.041017] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.041017] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2989937c-6050-493e-a1d8-79a52d9b6132 is going to be updated. [ 975.071641] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.071787] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.071853] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.072080] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.072228] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.084652] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: IN_PROGRESS for 2s [ 976.340675] env[66834]: INFO networking_nsxv3.common.synchronization [req-0f441bf6-bf97-4fc9-b8d4-efd22e6ae5b1 req-6c2ea3b4-f95a-4584-b919-87964e8c6165 tempest-ServerGroupTestJSON-1952628022 tempest-ServerGroupTestJSON-1952628022-project-member] Enqueued Resource ID: 0499d8ef-26b2-4caa-99c4-df9d91f4f626 with Priority: HIGHEST for action security_group_members [ 976.341215] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0499d8ef-26b2-4caa-99c4-df9d91f4f626 with Priority: HIGHEST for action security_group_members [ 976.341836] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-0499d8ef-26b2-4caa-99c4-df9d91f4f626 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.341836] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.341836] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.342038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.342165] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.342263] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.342320] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.344247] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.344247] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.344247] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0499d8ef-26b2-4caa-99c4-df9d91f4f626',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.797139] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-777 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.797377] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-777" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.797424] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-777" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.797753] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-777" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.798038] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.798270] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.798418] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.798732] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.798845] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.799078] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 976.799197] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 976.799323] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 976.799439] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 976.799553] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 976.799664] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 976.799869] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 976.820650] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 976.820650] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 976.820796] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 976.820957] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-777" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.821353] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-2b828474-6f2a-4d59-8989-1ee2b3b344f9 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.821525] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-2b828474-6f2a-4d59-8989-1ee2b3b344f9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.821665] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-2b828474-6f2a-4d59-8989-1ee2b3b344f9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.822034] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-2b828474-6f2a-4d59-8989-1ee2b3b344f9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.822164] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b828474-6f2a-4d59-8989-1ee2b3b344f9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.847614] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.847803] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.847845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.848179] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.848179] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.848395] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.848488] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.848527] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.848731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.848791] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.848868] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0499d8ef-26b2-4caa-99c4-df9d91f4f626 already deleted. [ 976.849014] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.862868] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: SUCCESS [ 976.863138] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.863356] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.863637] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.863891] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.863891] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.864029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.864162] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.864299] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.864299] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.864804] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.094632] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: SUCCESS [ 977.095477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.095477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.095477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.095900] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.095900] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.095900] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.096101] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.096101] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.096182] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.096302] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.325483] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.325483] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.325598] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.325810] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.325963] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.326202] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 2b828474-6f2a-4d59-8989-1ee2b3b344f9 not found, creating... [ 977.326465] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.326634] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.326734] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.326968] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.327117] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.327407] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.327596] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.327749] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.328058] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.328116] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.328298] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 2b828474-6f2a-4d59-8989-1ee2b3b344f9 is going to be created. [ 977.358779] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.359101] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.359285] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.359386] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.359884] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.360059] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-2b828474-6f2a-4d59-8989-1ee2b3b344f9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.366646] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.598625] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.599354] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.599354] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.599999] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.599999] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.600193] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.600328] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.600586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.600758] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.600792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.602024] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.602024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.602024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.602024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.602024] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.602024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.602024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.602024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.602024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.602024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.602024] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.869171] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06251551-417e-4f8a-9412-fdb5036f57fe: rpc.has_security_group_logging(os_id): False [ 977.896211] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.896359] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.896426] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.896743] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.896846] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.897115] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.897214] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.897272] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.897428] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.897497] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.897579] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06251551-417e-4f8a-9412-fdb5036f57fe is going to be updated. [ 978.004848] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.005020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.005098] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.005278] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.005426] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.028728] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: IN_PROGRESS for 2s [ 978.078505] env[66834]: INFO networking_nsxv3.common.synchronization [req-0f441bf6-bf97-4fc9-b8d4-efd22e6ae5b1 req-b49de384-6ae5-46b9-9d70-178eac476985 service nova] Enqueued Resource ID: 0499d8ef-26b2-4caa-99c4-df9d91f4f626 with Priority: HIGHEST for action security_group_rules [ 978.078628] env[66834]: INFO networking_nsxv3.common.synchronization [req-0f441bf6-bf97-4fc9-b8d4-efd22e6ae5b1 req-b49de384-6ae5-46b9-9d70-178eac476985 service nova] Enqueued Resource ID: 0499d8ef-26b2-4caa-99c4-df9d91f4f626 with Priority: HIGHEST for action security_group_members [ 978.078766] env[66834]: INFO networking_nsxv3.common.synchronization [req-0f441bf6-bf97-4fc9-b8d4-efd22e6ae5b1 req-b49de384-6ae5-46b9-9d70-178eac476985 service nova] Enqueued Resource ID: 2b828474-6f2a-4d59-8989-1ee2b3b344f9 with Priority: HIGHEST for action port [ 978.079341] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0499d8ef-26b2-4caa-99c4-df9d91f4f626 with Priority: HIGHEST for action security_group_rules [ 978.079479] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0499d8ef-26b2-4caa-99c4-df9d91f4f626 with Priority: HIGHEST for action security_group_members [ 978.079574] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b828474-6f2a-4d59-8989-1ee2b3b344f9 with Priority: HIGHEST for action port [ 978.079892] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0499d8ef-26b2-4caa-99c4-df9d91f4f626 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.080078] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.080121] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.080437] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.080437] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0499d8ef-26b2-4caa-99c4-df9d91f4f626',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.081504] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-0499d8ef-26b2-4caa-99c4-df9d91f4f626 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.081675] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.081780] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.085441] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.085441] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.085441] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.085441] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.085441] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.085441] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.085441] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0499d8ef-26b2-4caa-99c4-df9d91f4f626',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.085441] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b828474-6f2a-4d59-8989-1ee2b3b344f9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.085441] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b828474-6f2a-4d59-8989-1ee2b3b344f9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.085441] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b828474-6f2a-4d59-8989-1ee2b3b344f9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.085441] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b828474-6f2a-4d59-8989-1ee2b3b344f9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.085441] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b828474-6f2a-4d59-8989-1ee2b3b344f9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.103977] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2989937c-6050-493e-a1d8-79a52d9b6132: rpc.has_security_group_logging(os_id): False [ 978.147863] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.148074] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.148145] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.148407] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.148504] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.149252] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.149252] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.149252] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.149252] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.149252] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.149543] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.149543] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.149543] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.149753] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.149829] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.150019] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.154309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.154468] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.154649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.154791] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.154955] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2989937c-6050-493e-a1d8-79a52d9b6132 is going to be updated. [ 978.245464] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.245464] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.245464] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.245649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.245789] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.261221] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: IN_PROGRESS for 2s [ 978.462742] env[66834]: INFO networking_nsxv3.common.synchronization [None req-76106357-6a41-4d4e-81c4-e1154b13028a tempest-ServerActionsTestOtherA-283121819 tempest-ServerActionsTestOtherA-283121819-project-member] Enqueued Resource ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d with Priority: HIGHEST for action security_group_rules [ 978.462742] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d with Priority: HIGHEST for action security_group_rules [ 978.463778] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0750b6a7-8358-4db0-b46f-3ccbf925625d taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.465322] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.465322] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.465322] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.465322] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0750b6a7-8358-4db0-b46f-3ccbf925625d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.564679] env[66834]: INFO networking_nsxv3.common.synchronization [None req-8794912b-1764-476a-8d17-6d99b572fa56 tempest-ServerActionsTestOtherA-283121819 tempest-ServerActionsTestOtherA-283121819-project-member] Enqueued Resource ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d with Priority: HIGHEST for action security_group_rules [ 978.564679] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d with Priority: HIGHEST for action security_group_rules [ 978.564679] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0750b6a7-8358-4db0-b46f-3ccbf925625d taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.564679] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.586995] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-0499d8ef-26b2-4caa-99c4-df9d91f4f626 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.587159] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.587355] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0499d8ef-26b2-4caa-99c4-df9d91f4f626',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.588722] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b828474-6f2a-4d59-8989-1ee2b3b344f9 with status ACTIVE [ 978.588722] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.588722] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.588722] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.588965] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.589077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.589280] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.589396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.589459] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.589628] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.589705] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.589889] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.590042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.590080] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.590198] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.590287] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.590417] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b828474-6f2a-4d59-8989-1ee2b3b344f9 is going to be updated. [ 978.620069] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.620069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.620069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.620069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.620341] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.620387] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b828474-6f2a-4d59-8989-1ee2b3b344f9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.996883] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.997122] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.997234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.997695] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.997779] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.997902] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d already deleted. [ 978.998070] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.998301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.998661] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.998661] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0750b6a7-8358-4db0-b46f-3ccbf925625d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.093439] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0499d8ef-26b2-4caa-99c4-df9d91f4f626',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.323133] env[66834]: INFO networking_nsxv3.common.synchronization [req-ae7bb21f-8930-463f-ae65-e425eef3ed51 req-8b4505a7-35c1-4704-b4fe-afc0612f8ff0 tempest-ImagesTestJSON-910661197 tempest-ImagesTestJSON-910661197-project-member] Enqueued Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 979.323741] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGHEST for action security_group_members [ 979.324067] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.324194] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.324260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.324457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.324605] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.324703] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.324761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.324901] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.324983] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.325631] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.522114] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.522440] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.522440] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.522516] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.524104] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.524104] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d already deleted. [ 979.524104] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.598842] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.598842] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.598842] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.598842] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.598842] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.598842] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0499d8ef-26b2-4caa-99c4-df9d91f4f626 is going to be created. [ 979.630587] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.630870] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.630870] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.631137] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.631225] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.652693] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0499d8ef-26b2-4caa-99c4-df9d91f4f626 in Status: UNINITIALIZED for 2s [ 979.827577] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.827697] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.827767] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.828163] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.829981] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.830285] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.830414] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.830548] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.831471] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.831471] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.831471] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 is going to be updated. [ 979.867830] env[66834]: INFO networking_nsxv3.common.synchronization [req-8e92e33d-b7ea-4140-ba20-9129a20595e6 req-4d2476cb-97f8-4ba5-bdee-03ce3f4eb42a tempest-MultipleCreateTestJSON-60451393 tempest-MultipleCreateTestJSON-60451393-project-member] Enqueued Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_members [ 979.868674] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_members [ 979.869079] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.869079] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.869343] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.869343] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.869508] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.869604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.869659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.869936] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.870030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.870119] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.871946] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.871946] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.871946] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.872635] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.872635] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.886087] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: IN_PROGRESS for 2s [ 980.044073] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: SUCCESS [ 980.044073] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.282236] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: SUCCESS [ 980.282236] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.340346] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-413 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.340552] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-413" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.340691] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-413" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.340987] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-413" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.341270] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.341429] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.341597] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.341861] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.342064] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.344685] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 980.344912] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 980.345064] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 980.345178] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 980.345291] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 980.345395] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 980.345533] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 980.366471] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 980.366714] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 980.366827] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 980.367070] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-413" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.367393] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-83f42785-9f80-48b0-b3ec-1a126b9a9c8d taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.367569] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-83f42785-9f80-48b0-b3ec-1a126b9a9c8d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.367668] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-83f42785-9f80-48b0-b3ec-1a126b9a9c8d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.367989] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-83f42785-9f80-48b0-b3ec-1a126b9a9c8d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.368138] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83f42785-9f80-48b0-b3ec-1a126b9a9c8d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.375372] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.375536] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.375586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.375792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.375878] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.376090] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.376186] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.376401] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.376401] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.376486] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.376548] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 is going to be updated. [ 980.405908] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.406145] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.406283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.407057] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.407057] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.417583] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: IN_PROGRESS for 2s [ 980.871241] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.871621] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.871621] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.872088] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.872088] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.872184] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 83f42785-9f80-48b0-b3ec-1a126b9a9c8d not found, creating... [ 980.872439] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.872594] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.872959] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.872959] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.873094] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.873313] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.873461] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.873856] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.873856] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.873949] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.874086] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 83f42785-9f80-48b0-b3ec-1a126b9a9c8d is going to be created. [ 980.899030] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.899030] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.899222] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.899364] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.899724] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.899994] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-83f42785-9f80-48b0-b3ec-1a126b9a9c8d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.605348] env[66834]: INFO networking_nsxv3.common.synchronization [req-8e92e33d-b7ea-4140-ba20-9129a20595e6 req-9ec94e90-0ec9-472c-8082-c3c64c67a218 service nova] Enqueued Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_rules [ 981.605526] env[66834]: INFO networking_nsxv3.common.synchronization [req-8e92e33d-b7ea-4140-ba20-9129a20595e6 req-9ec94e90-0ec9-472c-8082-c3c64c67a218 service nova] Enqueued Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_members [ 981.605667] env[66834]: INFO networking_nsxv3.common.synchronization [req-8e92e33d-b7ea-4140-ba20-9129a20595e6 req-9ec94e90-0ec9-472c-8082-c3c64c67a218 service nova] Enqueued Resource ID: 83f42785-9f80-48b0-b3ec-1a126b9a9c8d with Priority: HIGHEST for action port [ 981.606925] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_rules [ 981.606925] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_members [ 981.606925] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83f42785-9f80-48b0-b3ec-1a126b9a9c8d with Priority: HIGHEST for action port [ 981.606925] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49d65b4d-9206-4925-b862-2ad0f3d9eaf1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.606925] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.606925] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.607554] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.607554] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.608223] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.608319] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.608513] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-83f42785-9f80-48b0-b3ec-1a126b9a9c8d taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.608614] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83f42785-9f80-48b0-b3ec-1a126b9a9c8d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.608712] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83f42785-9f80-48b0-b3ec-1a126b9a9c8d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.608931] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83f42785-9f80-48b0-b3ec-1a126b9a9c8d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.608987] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83f42785-9f80-48b0-b3ec-1a126b9a9c8d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.665569] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0499d8ef-26b2-4caa-99c4-df9d91f4f626 in Status: SUCCESS [ 981.665809] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.666009] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.666259] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.666517] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.666688] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.666794] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.668803] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.668803] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.668803] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.668803] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0499d8ef-26b2-4caa-99c4-df9d91f4f626',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.900724] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 in Status: SUCCESS [ 981.900724] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 deletion is rescheduled due to dependency. [ 981.900724] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.112422] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.112422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.112422] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83f42785-9f80-48b0-b3ec-1a126b9a9c8d with status ACTIVE [ 982.112422] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.112422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.112422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.112422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.112422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.112422] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.112422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.112422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.113039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.113039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.113039] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.113039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.113039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.114062] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.114219] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.114268] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83f42785-9f80-48b0-b3ec-1a126b9a9c8d is going to be updated. [ 982.141840] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.141934] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.142585] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.142585] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.142585] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.142585] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83f42785-9f80-48b0-b3ec-1a126b9a9c8d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.170254] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-0499d8ef-26b2-4caa-99c4-df9d91f4f626 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.170442] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.170592] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.170893] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.171083] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.171222] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.171309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.171481] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.171565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.171652] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.171808] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-0499d8ef-26b2-4caa-99c4-df9d91f4f626 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.171915] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.171975] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.172183] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.172332] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.172435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.172473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.172607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.172686] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.172767] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.172864] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0499d8ef-26b2-4caa-99c4-df9d91f4f626',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.430299] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: SUCCESS [ 982.432030] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 deletion is rescheduled due to dependency. [ 982.432030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.432030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.432195] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.432359] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.432506] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.432620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.436018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.436018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.436018] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.538138] env[66834]: INFO networking_nsxv3.common.synchronization [req-8e92e33d-b7ea-4140-ba20-9129a20595e6 req-47a737c0-97ba-4961-a1f1-b1724349efe5 tempest-MultipleCreateTestJSON-60451393 tempest-MultipleCreateTestJSON-60451393-project-member] Enqueued Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_members [ 982.539218] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_members [ 982.539545] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.539649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.676171] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0499d8ef-26b2-4caa-99c4-df9d91f4f626: rpc.has_security_group_logging(os_id): False [ 982.701314] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.701869] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.702000] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.702261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.702364] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.702604] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.702736] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.702810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.702977] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.703067] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.703258] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.703357] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.703420] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.703560] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.703632] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.703811] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.703903] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.703960] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.706906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.706906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.706906] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0499d8ef-26b2-4caa-99c4-df9d91f4f626 is going to be created. [ 982.783119] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.783311] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.783311] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.783498] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.783680] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.797437] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0499d8ef-26b2-4caa-99c4-df9d91f4f626 in Status: IN_PROGRESS for 2s [ 982.821282] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-413 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.821504] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-413" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.821634] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-413" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.821838] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-413" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.822181] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.822385] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.822535] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.822841] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.822983] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.823242] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 982.823388] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 982.823525] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 982.823763] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 982.823763] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 982.823929] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 982.824107] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 982.845518] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 982.845789] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 982.845940] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 982.846192] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-413" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.846566] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-3d90ff4e-ccb0-46f1-803d-d9456eaf3aaa taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.846782] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-3d90ff4e-ccb0-46f1-803d-d9456eaf3aaa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.846916] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-3d90ff4e-ccb0-46f1-803d-d9456eaf3aaa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.847432] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-3d90ff4e-ccb0-46f1-803d-d9456eaf3aaa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.847624] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d90ff4e-ccb0-46f1-803d-d9456eaf3aaa',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.939078] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.353696] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.353949] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.354091] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.354371] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.354511] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.354676] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 3d90ff4e-ccb0-46f1-803d-d9456eaf3aaa not found, creating... [ 983.354941] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.355099] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.355207] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.355420] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.355550] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.356140] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.356140] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.356366] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.356417] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.356608] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.356667] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 3d90ff4e-ccb0-46f1-803d-d9456eaf3aaa is going to be created. [ 983.388941] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.389175] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.389362] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.389553] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.389774] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.390013] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-3d90ff4e-ccb0-46f1-803d-d9456eaf3aaa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.441873] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.783506] env[66834]: INFO networking_nsxv3.common.synchronization [None req-21842369-6a38-4577-8413-f8fd28d51e92 tempest-AttachVolumeNegativeTest-457073585 tempest-AttachVolumeNegativeTest-457073585-project-member] Enqueued Resource ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf with Priority: HIGHEST for action security_group_rules [ 983.784065] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf with Priority: HIGHEST for action security_group_rules [ 983.784375] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c936d9b1-70e6-41ff-b4fc-481a320e93bf taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.784488] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.784599] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.784804] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.784962] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c936d9b1-70e6-41ff-b4fc-481a320e93bf',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.899769] env[66834]: INFO networking_nsxv3.common.synchronization [None req-087c7958-a4fa-4971-8b37-bf64985626fc tempest-AttachVolumeNegativeTest-457073585 tempest-AttachVolumeNegativeTest-457073585-project-member] Enqueued Resource ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf with Priority: HIGHEST for action security_group_rules [ 983.900449] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf with Priority: HIGHEST for action security_group_rules [ 983.901106] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c936d9b1-70e6-41ff-b4fc-481a320e93bf taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.901254] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.943780] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.946297] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.946297] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.946297] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.946297] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.946297] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 is going to be updated. [ 983.976265] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.976545] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.976545] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.976794] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.977047] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.986456] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: IN_PROGRESS for 2s [ 984.081297] env[66834]: INFO networking_nsxv3.common.synchronization [req-8e92e33d-b7ea-4140-ba20-9129a20595e6 req-2350846b-6c53-4927-b9ae-d25fefed3b37 service nova] Enqueued Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_rules [ 984.081474] env[66834]: INFO networking_nsxv3.common.synchronization [req-8e92e33d-b7ea-4140-ba20-9129a20595e6 req-2350846b-6c53-4927-b9ae-d25fefed3b37 service nova] Enqueued Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_members [ 984.081704] env[66834]: INFO networking_nsxv3.common.synchronization [req-8e92e33d-b7ea-4140-ba20-9129a20595e6 req-2350846b-6c53-4927-b9ae-d25fefed3b37 service nova] Enqueued Resource ID: 3d90ff4e-ccb0-46f1-803d-d9456eaf3aaa with Priority: HIGHEST for action port [ 984.083305] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_rules [ 984.083520] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_members [ 984.083673] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d90ff4e-ccb0-46f1-803d-d9456eaf3aaa with Priority: HIGHEST for action port [ 984.084032] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49d65b4d-9206-4925-b862-2ad0f3d9eaf1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.084438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.084732] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.084876] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.085287] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d90ff4e-ccb0-46f1-803d-d9456eaf3aaa taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.085532] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d90ff4e-ccb0-46f1-803d-d9456eaf3aaa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.085532] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d90ff4e-ccb0-46f1-803d-d9456eaf3aaa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.086035] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d90ff4e-ccb0-46f1-803d-d9456eaf3aaa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.086183] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d90ff4e-ccb0-46f1-803d-d9456eaf3aaa',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.311033] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.311033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.311033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.311033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.311033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.311033] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf already deleted. [ 984.311033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.311033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.311033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.311033] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c936d9b1-70e6-41ff-b4fc-481a320e93bf',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.591124] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3d90ff4e-ccb0-46f1-803d-d9456eaf3aaa with status ACTIVE [ 984.591124] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.591300] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.591568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.591831] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.591952] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.592174] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.592305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.592533] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.592677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.592760] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.594136] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.594136] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.594136] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.594136] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.594136] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.594136] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3d90ff4e-ccb0-46f1-803d-d9456eaf3aaa is going to be updated. [ 984.619141] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.619141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.619141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.619349] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.619391] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.619555] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d90ff4e-ccb0-46f1-803d-d9456eaf3aaa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.810616] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0499d8ef-26b2-4caa-99c4-df9d91f4f626 in Status: SUCCESS [ 984.810848] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.836015] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.836015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.836015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.836015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.836015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.836015] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf already deleted. [ 984.836015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.000166] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: SUCCESS [ 986.000522] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.000666] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.000817] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.001041] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.001163] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.001227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.001413] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.001492] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.001595] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.001693] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.003171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.003349] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.003642] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.003759] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.003821] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.003965] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.004053] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.004137] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.503816] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.503957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.507398] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.009918] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.099915] env[66834]: INFO networking_nsxv3.common.synchronization [req-5d844bc8-8d6c-4954-8565-9b7defe3ed85 req-2b296f45-1db8-44df-88c3-1f1063d032d1 tempest-DeleteServersTestJSON-1250802255 tempest-DeleteServersTestJSON-1250802255-project-member] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 987.100847] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 987.102523] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.102523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.102523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.102683] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.102767] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.102854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.103747] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.103747] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.103747] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.103747] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.388009] env[66834]: INFO networking_nsxv3.common.synchronization [req-5fc3b3ce-d0fb-4909-be08-3183a233bfd6 req-ef886265-b3ed-4eea-837e-5fe4929c67e6 tempest-AttachInterfacesTestJSON-77868371 tempest-AttachInterfacesTestJSON-77868371-project-member] Enqueued Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 987.388530] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 987.389609] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.389609] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.389609] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.389609] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.389609] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.390976] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.391077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.391235] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.391333] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.391427] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.452912] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-606 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.453089] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.453185] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.453482] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.453754] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.453912] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.454039] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.454273] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.454414] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.454618] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 987.454733] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 987.454836] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 987.454943] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 987.455131] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 987.455258] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 987.455388] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 987.477374] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 987.477572] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 987.477710] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 987.477877] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.478225] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-14a22921-672b-4e18-9434-c113b1730482 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.478387] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-14a22921-672b-4e18-9434-c113b1730482" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.478538] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-14a22921-672b-4e18-9434-c113b1730482" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.478874] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-14a22921-672b-4e18-9434-c113b1730482" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.479478] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14a22921-672b-4e18-9434-c113b1730482',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.512810] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.512981] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.514337] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.514337] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.514337] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.514337] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 is going to be updated. [ 987.544363] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.544363] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.544363] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.544363] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.544363] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.556262] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: IN_PROGRESS for 2s [ 987.605330] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.605495] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.606572] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.606572] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.606572] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.606572] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.606572] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.606572] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.606572] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.606572] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.606572] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be updated. [ 987.642731] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.642955] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.642955] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.643192] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.643329] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.654727] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: IN_PROGRESS for 2s [ 987.681368] env[66834]: INFO networking_nsxv3.common.synchronization [None req-3c8cf2cf-41ae-460c-b417-3ebaee1aa3b4 tempest-AttachInterfacesTestJSON-77868371 tempest-AttachInterfacesTestJSON-77868371-project-member] Enqueued Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 987.681368] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 987.681368] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.681685] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.893120] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.983904] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.984214] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.984349] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.984641] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.984797] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.984950] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 14a22921-672b-4e18-9434-c113b1730482 not found, creating... [ 987.985222] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.985378] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.985510] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.985726] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.985859] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.986493] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.986662] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.986782] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.986991] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.987138] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.987315] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 14a22921-672b-4e18-9434-c113b1730482 is going to be created. [ 988.006704] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.006899] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.007028] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.007300] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.007532] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.007751] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-14a22921-672b-4e18-9434-c113b1730482" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.395436] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.724510] env[66834]: INFO networking_nsxv3.common.synchronization [req-5d844bc8-8d6c-4954-8565-9b7defe3ed85 req-5babdc81-c3e0-4fe9-8f6b-b86e0a37ae8c service nova] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_rules [ 988.724619] env[66834]: INFO networking_nsxv3.common.synchronization [req-5d844bc8-8d6c-4954-8565-9b7defe3ed85 req-5babdc81-c3e0-4fe9-8f6b-b86e0a37ae8c service nova] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 988.724763] env[66834]: INFO networking_nsxv3.common.synchronization [req-5d844bc8-8d6c-4954-8565-9b7defe3ed85 req-5babdc81-c3e0-4fe9-8f6b-b86e0a37ae8c service nova] Enqueued Resource ID: 14a22921-672b-4e18-9434-c113b1730482 with Priority: HIGHEST for action port [ 988.725353] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_rules [ 988.725517] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 988.725615] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14a22921-672b-4e18-9434-c113b1730482 with Priority: HIGHEST for action port [ 988.726637] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.726637] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.726637] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.726637] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.726637] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.727745] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.727745] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.727887] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-14a22921-672b-4e18-9434-c113b1730482 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.728015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14a22921-672b-4e18-9434-c113b1730482" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.728088] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14a22921-672b-4e18-9434-c113b1730482" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.728280] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14a22921-672b-4e18-9434-c113b1730482" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.728357] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14a22921-672b-4e18-9434-c113b1730482',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.898107] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.898221] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.898294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.898560] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.898663] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.898758] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2989937c-6050-493e-a1d8-79a52d9b6132 is going to be updated. [ 988.929816] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.929816] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.929816] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.929816] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.929816] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.940086] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: IN_PROGRESS for 2s [ 989.230963] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.230963] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.231223] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14a22921-672b-4e18-9434-c113b1730482 with status ACTIVE [ 989.231404] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.231521] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.231587] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.231799] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.231889] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.232153] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.232283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.232367] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.232574] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.232769] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.233063] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.233230] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.233320] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.233511] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.233624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.233778] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14a22921-672b-4e18-9434-c113b1730482 is going to be updated. [ 989.269892] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.270179] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.270290] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.270488] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.270701] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.270885] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14a22921-672b-4e18-9434-c113b1730482" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.571409] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: SUCCESS [ 989.571409] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.571409] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.571793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.571793] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.571898] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.572026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.572155] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.572260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.572388] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.666285] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: SUCCESS [ 989.666495] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a deletion is rescheduled due to dependency. [ 989.666560] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.666731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.666959] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.667163] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.667295] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.667390] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.667548] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.667601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.667692] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.967203] env[66834]: INFO networking_nsxv3.common.synchronization [req-57daa027-e520-4550-b1a8-16faf6fee8c7 req-40c55250-b021-4dc4-8d91-3a03d936a183 tempest-ServerGroupTestJSON-1952628022 tempest-ServerGroupTestJSON-1952628022-project-member] Enqueued Resource ID: 0499d8ef-26b2-4caa-99c4-df9d91f4f626 with Priority: HIGHEST for action security_group_members [ 989.968011] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0499d8ef-26b2-4caa-99c4-df9d91f4f626 with Priority: HIGHEST for action security_group_members [ 989.968683] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-0499d8ef-26b2-4caa-99c4-df9d91f4f626 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.968879] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.968994] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.969385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.969614] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.969763] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.969855] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.970117] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.970271] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.970440] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0499d8ef-26b2-4caa-99c4-df9d91f4f626',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.075401] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.170926] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.472730] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.472942] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.473024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.473303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.473375] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.473665] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.473665] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.473919] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.473919] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.473984] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.474057] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0499d8ef-26b2-4caa-99c4-df9d91f4f626 is going to be updated. [ 990.506215] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.506421] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.506421] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.506619] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.506762] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.518924] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0499d8ef-26b2-4caa-99c4-df9d91f4f626 in Status: IN_PROGRESS for 2s [ 990.579055] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.674710] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.945690] env[66834]: INFO networking_nsxv3.common.synchronization [req-b632af15-478d-4a45-a28e-7dff8bbba0cf req-56924269-21ae-40e3-ab11-12aa0e7fbc1a tempest-AttachInterfacesTestJSON-77868371 tempest-AttachInterfacesTestJSON-77868371-project-member] Enqueued Resource ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 with Priority: HIGHEST for action security_group_members [ 990.946214] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 with Priority: HIGHEST for action security_group_members [ 990.946617] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-074f3129-4b43-4c6a-91e1-f738692c4d34 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.946777] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.946845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.947433] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.947433] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.947433] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.947433] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.947714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.947714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.947807] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('074f3129-4b43-4c6a-91e1-f738692c4d34',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.952823] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: SUCCESS [ 990.954490] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.954490] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.954490] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.954490] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.954490] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.955094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.955094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.955094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.955094] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.081957] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.084434] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.084434] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.084434] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.084434] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.084434] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 is going to be updated. [ 991.124955] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.125330] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.125415] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.125976] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.125976] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.142557] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: IN_PROGRESS for 2s [ 991.177517] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.177750] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.177750] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.178158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.178158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.178293] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be updated. [ 991.209550] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.209707] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.209793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.209997] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.210389] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.223760] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: IN_PROGRESS for 2s [ 991.454659] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.454659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.454659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.454659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.454659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.454659] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.454659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.454659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.454659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.454659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.454659] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 is going to be updated. [ 991.458658] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.458763] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.458802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.459016] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.459112] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.459295] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.459737] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.459737] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.460637] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.460637] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.460637] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2989937c-6050-493e-a1d8-79a52d9b6132 is going to be updated. [ 991.491700] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.491700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.491700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.491700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.491700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.491700] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.491700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.491700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.491700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.491700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.505693] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 in Status: IN_PROGRESS for 2s [ 991.506341] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: IN_PROGRESS for 2s [ 992.239046] env[66834]: INFO networking_nsxv3.common.synchronization [req-e28b762d-c0d4-4ff9-bbf2-997f873d930f req-a588b4c1-0e9d-4dc2-9427-5dd56070e650 tempest-ServersAdminTestJSON-835845617 tempest-ServersAdminTestJSON-835845617-project-member] Enqueued Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_members [ 992.239997] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_members [ 992.239997] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.240199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.240262] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.240470] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.240722] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.240827] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.240886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.241074] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.241169] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.241264] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.531271] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0499d8ef-26b2-4caa-99c4-df9d91f4f626 in Status: SUCCESS [ 992.531469] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0499d8ef-26b2-4caa-99c4-df9d91f4f626 deletion is rescheduled due to dependency. [ 992.531609] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.746134] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.153195] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: SUCCESS [ 993.153960] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.153960] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.153960] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.154146] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.154217] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.154217] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.154380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.154459] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.154541] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.154693] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.154785] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.154846] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.154984] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.155134] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.155225] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.155283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.155753] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.155852] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.155943] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.156055] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.233856] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: SUCCESS [ 993.234151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.234361] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.234651] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.234918] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.235076] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.235170] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.235354] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.235462] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.235588] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.235715] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.248083] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.517627] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 in Status: SUCCESS [ 993.517809] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 deletion is rescheduled due to dependency. [ 993.517927] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.518700] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: SUCCESS [ 993.518856] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2989937c-6050-493e-a1d8-79a52d9b6132 deletion is rescheduled due to dependency. [ 993.518953] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.658117] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49d65b4d-9206-4925-b862-2ad0f3d9eaf1: rpc.has_security_group_logging(os_id): False [ 993.677983] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.678250] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.678355] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.678630] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.678751] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.679249] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.679249] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.679249] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.679461] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.679566] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.679795] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.679987] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.679987] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.680481] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.680540] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.680860] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.680994] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.680994] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.681169] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.681260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.681363] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 is going to be updated. [ 993.693795] env[66834]: INFO networking_nsxv3.common.synchronization [req-bea1e012-a3af-417d-814e-42fcbba8bf10 req-a8bccde4-ad35-4c4e-a196-3ffb3d1395e9 tempest-InstanceActionsNegativeTestJSON-651650843 tempest-InstanceActionsNegativeTestJSON-651650843-project-member] Enqueued Resource ID: 482d0336-6e92-4922-86a3-e6d489211f48 with Priority: HIGHEST for action security_group_members [ 993.694351] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482d0336-6e92-4922-86a3-e6d489211f48 with Priority: HIGHEST for action security_group_members [ 993.694654] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-482d0336-6e92-4922-86a3-e6d489211f48 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.694794] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.694881] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.695172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.695330] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.695428] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.695490] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.695645] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.695756] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.695856] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('482d0336-6e92-4922-86a3-e6d489211f48',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.737960] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.738216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.738296] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.738525] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.738809] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.738809] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.738908] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.739036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.739135] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.739225] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.739376] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.739469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.739529] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.739703] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.739845] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.739933] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.740360] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.740360] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.740360] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.740360] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.740527] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.748188] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.748351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.748430] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.748749] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.748951] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.750623] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.750738] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.750805] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.751088] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.751189] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.751317] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9276c5a5-af43-4c6e-899f-c34039400160 is going to be updated. [ 993.768266] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: IN_PROGRESS for 2s [ 993.784566] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.784566] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.784566] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.784566] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.784958] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.796151] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: IN_PROGRESS for 2s [ 994.055559] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-360 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.055781] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-360" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.055947] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-360" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.056264] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-360" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.056433] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.056584] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.056697] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.056906] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.057063] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.057272] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.057381] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.057484] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.057587] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.057709] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.057788] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.057916] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.088996] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.088996] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 994.088996] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.088996] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-360" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.089296] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-ee290ec6-0be2-418c-a355-5c79739835a4 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.089465] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-ee290ec6-0be2-418c-a355-5c79739835a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.089583] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-ee290ec6-0be2-418c-a355-5c79739835a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.089914] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-ee290ec6-0be2-418c-a355-5c79739835a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.090064] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee290ec6-0be2-418c-a355-5c79739835a4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.198305] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.198506] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.198506] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.198784] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.198881] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.199101] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.199238] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.199304] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.199544] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.199648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.199728] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482d0336-6e92-4922-86a3-e6d489211f48 already deleted. [ 994.199817] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.243944] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a15c14c6-0aee-4e9d-b481-2661c510f44a: rpc.has_security_group_logging(os_id): False [ 994.284531] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.285028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.285028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.285028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.285221] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.285357] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.285493] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.285566] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.285711] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.285798] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.286036] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.286141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.286206] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.286316] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.286388] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.286592] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.286698] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.286826] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.286876] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.286927] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.287034] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be updated. [ 994.369273] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.369474] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.369520] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.369754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.369935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.388143] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: IN_PROGRESS for 2s [ 994.595197] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.596854] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.596854] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.596854] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.596854] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.596854] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port ee290ec6-0be2-418c-a355-5c79739835a4 not found, creating... [ 994.596854] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.596854] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.596854] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.596854] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.597309] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.597813] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.597813] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.597813] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.598122] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.598854] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.598854] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: ee290ec6-0be2-418c-a355-5c79739835a4 is going to be created. [ 994.622553] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.622553] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.622553] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.622553] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.622553] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.622553] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-ee290ec6-0be2-418c-a355-5c79739835a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.449030] env[66834]: INFO networking_nsxv3.common.synchronization [req-bea1e012-a3af-417d-814e-42fcbba8bf10 req-8fc3acc2-c8e9-44e7-899b-9bdfb15d9617 service nova] Enqueued Resource ID: 482d0336-6e92-4922-86a3-e6d489211f48 with Priority: HIGHEST for action security_group_rules [ 995.449030] env[66834]: INFO networking_nsxv3.common.synchronization [req-bea1e012-a3af-417d-814e-42fcbba8bf10 req-8fc3acc2-c8e9-44e7-899b-9bdfb15d9617 service nova] Enqueued Resource ID: 482d0336-6e92-4922-86a3-e6d489211f48 with Priority: HIGHEST for action security_group_members [ 995.449030] env[66834]: INFO networking_nsxv3.common.synchronization [req-bea1e012-a3af-417d-814e-42fcbba8bf10 req-8fc3acc2-c8e9-44e7-899b-9bdfb15d9617 service nova] Enqueued Resource ID: ee290ec6-0be2-418c-a355-5c79739835a4 with Priority: HIGHEST for action port [ 995.449030] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482d0336-6e92-4922-86a3-e6d489211f48 with Priority: HIGHEST for action security_group_rules [ 995.449030] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482d0336-6e92-4922-86a3-e6d489211f48 with Priority: HIGHEST for action security_group_members [ 995.449030] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee290ec6-0be2-418c-a355-5c79739835a4 with Priority: HIGHEST for action port [ 995.449708] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-482d0336-6e92-4922-86a3-e6d489211f48 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.450159] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.450314] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.450804] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.450974] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('482d0336-6e92-4922-86a3-e6d489211f48',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.452864] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-482d0336-6e92-4922-86a3-e6d489211f48 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.452996] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.453062] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.454171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.454171] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.454171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.454171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.454171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.454171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.454171] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('482d0336-6e92-4922-86a3-e6d489211f48',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.454606] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee290ec6-0be2-418c-a355-5c79739835a4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.454713] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee290ec6-0be2-418c-a355-5c79739835a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.454777] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee290ec6-0be2-418c-a355-5c79739835a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.454923] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee290ec6-0be2-418c-a355-5c79739835a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.454993] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee290ec6-0be2-418c-a355-5c79739835a4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.599141] env[66834]: INFO networking_nsxv3.common.synchronization [req-c1ddc2f3-46b5-4b42-a843-4028210708b7 req-4b5d5deb-e24c-4800-bb68-09bdeeb33797 tempest-MultipleCreateTestJSON-60451393 tempest-MultipleCreateTestJSON-60451393-project-member] Enqueued Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_members [ 995.599592] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_members [ 995.599901] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.600369] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.600369] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.600369] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.600540] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.600540] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.600644] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.600966] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.600966] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.600966] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.750942] env[66834]: INFO networking_nsxv3.common.synchronization [req-266d19f0-0076-4d0f-bae3-2a1f4228eb58 req-6a1c40ee-182e-4d66-8c35-4e12f319876f tempest-MultipleCreateTestJSON-60451393 tempest-MultipleCreateTestJSON-60451393-project-member] Enqueued Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_members [ 995.751460] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 with Priority: HIGHEST for action security_group_members [ 995.751821] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.751925] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.784328] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: SUCCESS [ 995.784537] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.785042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.785273] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.785360] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.806573] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: SUCCESS [ 995.806831] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.957291] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-482d0336-6e92-4922-86a3-e6d489211f48 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.957483] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.957709] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('482d0336-6e92-4922-86a3-e6d489211f48',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.958667] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee290ec6-0be2-418c-a355-5c79739835a4 with status ACTIVE [ 995.958900] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.959079] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.959160] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.959419] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.960548] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.960548] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.960548] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.960548] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.960548] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.960548] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.960548] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.960548] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.960548] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.960548] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.961030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.961030] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee290ec6-0be2-418c-a355-5c79739835a4 is going to be updated. [ 995.981906] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.982085] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.982141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.982323] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.982478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.982640] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee290ec6-0be2-418c-a355-5c79739835a4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.102583] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.309615] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.309791] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.309865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.310096] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.310281] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.310281] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 is going to be deleted. [ 996.364250] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.364399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.364469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.364679] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.364770] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.364909] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.407115] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: SUCCESS [ 996.407366] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.463232] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('482d0336-6e92-4922-86a3-e6d489211f48',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.604720] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.966481] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.967499] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.967595] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.967826] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.967923] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.968040] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482d0336-6e92-4922-86a3-e6d489211f48 is going to be created. [ 996.999392] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.999564] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.999693] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.999945] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.000131] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.018055] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482d0336-6e92-4922-86a3-e6d489211f48 in Status: UNINITIALIZED for 2s [ 997.110970] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.111159] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.111227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.111441] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.111531] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.111650] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 is going to be updated. [ 997.148838] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.149044] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.149088] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.149300] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.149445] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.163075] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: IN_PROGRESS for 2s [ 999.029010] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482d0336-6e92-4922-86a3-e6d489211f48 in Status: SUCCESS [ 999.029468] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.029468] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.029611] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.029822] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.029930] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.030041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.030141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.030223] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.030319] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.030392] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('482d0336-6e92-4922-86a3-e6d489211f48',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.173726] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 in Status: SUCCESS [ 999.173978] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.174236] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.174392] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.174654] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.175056] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.175056] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.175163] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.175201] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.175760] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49d65b4d-9206-4925-b862-2ad0f3d9eaf1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.533563] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-482d0336-6e92-4922-86a3-e6d489211f48 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.533563] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.534957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.534957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.534957] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.534957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.534957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.534957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.534957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.534957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.534957] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-482d0336-6e92-4922-86a3-e6d489211f48 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.534957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.534957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.535495] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.535495] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.535570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.535665] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.535829] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.535931] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.536053] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.536173] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('482d0336-6e92-4922-86a3-e6d489211f48',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.677863] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.678073] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.678139] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.678407] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.678595] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.678855] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.679010] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.679106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.679318] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.679429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.679543] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49d65b4d-9206-4925-b862-2ad0f3d9eaf1 is going to be deleted. [ 999.722862] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.723141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.723141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.723378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.723495] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.723632] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49d65b4d-9206-4925-b862-2ad0f3d9eaf1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.038027] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 482d0336-6e92-4922-86a3-e6d489211f48: rpc.has_security_group_logging(os_id): False [ 1000.057110] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.057266] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.057322] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.058026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.058026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.058026] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.058026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.058026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.058330] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.058330] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.058330] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.058465] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.058498] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.058651] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.058733] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.058913] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.059020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.059081] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.059220] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.059292] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.059374] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 482d0336-6e92-4922-86a3-e6d489211f48 is going to be created. [ 1000.121995] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.122158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.122226] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.122430] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.122597] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.136811] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 482d0336-6e92-4922-86a3-e6d489211f48 in Status: IN_PROGRESS for 2s [ 1000.752143] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1000.752299] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1001.485949] env[66834]: INFO networking_nsxv3.common.synchronization [req-5bbd702a-0ad2-4d59-bcaa-cd09242b797d req-6b7265bc-b81c-4408-86a9-5c483d7d09ea tempest-DeleteServersTestJSON-1250802255 tempest-DeleteServersTestJSON-1250802255-project-member] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 1001.486568] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 1001.486902] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.487045] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.487129] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.487351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.487815] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.487815] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.487815] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.487815] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.488081] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.488081] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.991589] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.991589] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.991589] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.991589] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.991589] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.991589] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.991589] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.991589] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.992180] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.992180] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.992180] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be updated. [ 1002.036465] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.036830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.036830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.037054] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.037229] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.048256] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: IN_PROGRESS for 2s [ 1002.157236] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 482d0336-6e92-4922-86a3-e6d489211f48 in Status: SUCCESS [ 1002.157471] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.762853] env[66834]: INFO networking_nsxv3.common.synchronization [req-dedd5bde-7378-40fc-aa8c-315c5c2564a2 req-f3350212-1383-4013-b3b7-a32df8610ed1 tempest-ImagesOneServerTestJSON-881436325 tempest-ImagesOneServerTestJSON-881436325-project-member] Enqueued Resource ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 with Priority: HIGHEST for action security_group_members [ 1003.763548] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 with Priority: HIGHEST for action security_group_members [ 1003.763857] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a374bf1-dcb9-4b0d-a02d-5649cc882880 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.763976] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.764056] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.764316] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.764458] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.764556] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.764617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.764973] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.764973] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.764973] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a374bf1-dcb9-4b0d-a02d-5649cc882880',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.061780] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: SUCCESS [ 1004.062063] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a deletion is rescheduled due to dependency. [ 1004.062117] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.086545] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-48 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.086786] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.086945] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.087260] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.087526] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.087683] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.087797] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.088030] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.088174] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.088376] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.088483] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1004.088611] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1004.088756] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1004.088875] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.088981] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1004.089124] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1004.108242] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1004.108448] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1004.108540] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1004.108791] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.109193] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-a3f3b0cb-61a1-4ab4-aa96-0399ba183a68 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.109377] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-a3f3b0cb-61a1-4ab4-aa96-0399ba183a68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.109494] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-a3f3b0cb-61a1-4ab4-aa96-0399ba183a68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.109810] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-a3f3b0cb-61a1-4ab4-aa96-0399ba183a68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.109948] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3f3b0cb-61a1-4ab4-aa96-0399ba183a68',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.269543] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.269543] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.269543] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.269802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.269802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.270092] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.270235] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.270317] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.270498] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.270608] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.270741] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 already deleted. [ 1004.270853] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.612251] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.612496] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.612603] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.613026] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.613187] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.613408] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port a3f3b0cb-61a1-4ab4-aa96-0399ba183a68 not found, creating... [ 1004.613681] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.613843] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.613956] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.614227] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.614452] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.614750] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.614990] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.615149] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.615358] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.615489] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.615625] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: a3f3b0cb-61a1-4ab4-aa96-0399ba183a68 is going to be created. [ 1004.637311] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.637513] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.637651] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.638016] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.640457] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.640457] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-a3f3b0cb-61a1-4ab4-aa96-0399ba183a68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.426599] env[66834]: INFO networking_nsxv3.common.synchronization [req-dedd5bde-7378-40fc-aa8c-315c5c2564a2 req-dda912b2-644b-48a2-98cb-6dcc80fd70c9 service nova] Enqueued Resource ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 with Priority: HIGHEST for action security_group_rules [ 1005.426848] env[66834]: INFO networking_nsxv3.common.synchronization [req-dedd5bde-7378-40fc-aa8c-315c5c2564a2 req-dda912b2-644b-48a2-98cb-6dcc80fd70c9 service nova] Enqueued Resource ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 with Priority: HIGHEST for action security_group_members [ 1005.426902] env[66834]: INFO networking_nsxv3.common.synchronization [req-dedd5bde-7378-40fc-aa8c-315c5c2564a2 req-dda912b2-644b-48a2-98cb-6dcc80fd70c9 service nova] Enqueued Resource ID: a3f3b0cb-61a1-4ab4-aa96-0399ba183a68 with Priority: HIGHEST for action port [ 1005.427487] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 with Priority: HIGHEST for action security_group_rules [ 1005.427631] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 with Priority: HIGHEST for action security_group_members [ 1005.427728] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3f3b0cb-61a1-4ab4-aa96-0399ba183a68 with Priority: HIGHEST for action port [ 1005.428013] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a374bf1-dcb9-4b0d-a02d-5649cc882880 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.428655] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.428731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.429000] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.429100] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a374bf1-dcb9-4b0d-a02d-5649cc882880',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.430174] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a374bf1-dcb9-4b0d-a02d-5649cc882880 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.431096] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.431233] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.431434] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.433136] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.433136] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.433136] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.433136] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.433136] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.433136] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a374bf1-dcb9-4b0d-a02d-5649cc882880',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.433868] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3f3b0cb-61a1-4ab4-aa96-0399ba183a68 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.433868] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3f3b0cb-61a1-4ab4-aa96-0399ba183a68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.433965] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3f3b0cb-61a1-4ab4-aa96-0399ba183a68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.435155] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3f3b0cb-61a1-4ab4-aa96-0399ba183a68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.435155] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3f3b0cb-61a1-4ab4-aa96-0399ba183a68',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.940019] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a374bf1-dcb9-4b0d-a02d-5649cc882880',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.940019] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a374bf1-dcb9-4b0d-a02d-5649cc882880 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.940019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.940019] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a3f3b0cb-61a1-4ab4-aa96-0399ba183a68 with status ACTIVE [ 1005.940019] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.940019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.940019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.940019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.940019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.940019] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.940019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.940019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.940019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.941085] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.942071] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.942454] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.943067] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.943267] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.943654] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.943654] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a3f3b0cb-61a1-4ab4-aa96-0399ba183a68 is going to be updated. [ 1005.964914] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.965056] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.965096] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.965645] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.965645] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.965645] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3f3b0cb-61a1-4ab4-aa96-0399ba183a68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.163567] env[66834]: INFO networking_nsxv3.common.synchronization [req-51e1d4a5-a78a-4f80-84b3-223b4aa7c6d3 req-99d45a5c-0f20-4817-b1ef-019c183b2dab tempest-InstanceActionsNegativeTestJSON-651650843 tempest-InstanceActionsNegativeTestJSON-651650843-project-member] Enqueued Resource ID: 482d0336-6e92-4922-86a3-e6d489211f48 with Priority: HIGHEST for action security_group_members [ 1006.163567] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482d0336-6e92-4922-86a3-e6d489211f48 with Priority: HIGHEST for action security_group_members [ 1006.163567] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-482d0336-6e92-4922-86a3-e6d489211f48 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.163567] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.163567] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.163567] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.163567] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.166238] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.167081] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.168130] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.168668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.169439] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('482d0336-6e92-4922-86a3-e6d489211f48',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.445930] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a374bf1-dcb9-4b0d-a02d-5649cc882880',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.676028] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.676028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.676028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.676028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.676028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.676028] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.676028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.676028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.676028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.676028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.676028] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482d0336-6e92-4922-86a3-e6d489211f48 is going to be updated. [ 1006.704816] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.704816] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.704816] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.705028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.705180] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.716090] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482d0336-6e92-4922-86a3-e6d489211f48 in Status: IN_PROGRESS for 2s [ 1006.952172] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.952172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.952172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.952172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.952172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.952172] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 is going to be created. [ 1006.997805] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.997805] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.997805] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.997805] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.997805] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.020387] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 in Status: UNINITIALIZED for 2s [ 1008.163889] env[66834]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1008.164278] env[66834]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] NSXv3 Agent Agent loop - iteration:2 started [ 1008.726937] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482d0336-6e92-4922-86a3-e6d489211f48 in Status: SUCCESS [ 1008.727279] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482d0336-6e92-4922-86a3-e6d489211f48 deletion is rescheduled due to dependency. [ 1008.727447] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.749591] env[66834]: INFO networking_nsxv3.common.synchronization [req-4201e407-ff7b-4fa3-a914-ff37c2f49d34 req-6e7cbdf2-7c8c-4677-b500-0315022e4516 tempest-ServerActionsTestOtherA-283121819 tempest-ServerActionsTestOtherA-283121819-project-member] Enqueued Resource ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d with Priority: HIGHEST for action security_group_members [ 1008.750330] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d with Priority: HIGHEST for action security_group_members [ 1008.750772] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-0750b6a7-8358-4db0-b46f-3ccbf925625d taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.750957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.751038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.751395] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.751576] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.751729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.751849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.752048] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.752187] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.752315] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0750b6a7-8358-4db0-b46f-3ccbf925625d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.030713] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 in Status: SUCCESS [ 1009.031029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.031361] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.031514] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.032465] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.032465] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.032465] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.032465] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.032465] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.032465] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.032465] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a374bf1-dcb9-4b0d-a02d-5649cc882880',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.110014] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.110206] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-590" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.110315] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-590" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.110592] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-590" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.110940] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.111207] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.111369] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.111629] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.111768] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.111976] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1009.112094] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1009.112193] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1009.112300] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1009.112391] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1009.112487] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1009.112608] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1009.134167] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1009.134264] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1009.135001] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1009.135001] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-590" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.135001] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-05af2089-258f-4cca-8ff5-410f9861a329 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.135312] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-05af2089-258f-4cca-8ff5-410f9861a329" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.135312] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-05af2089-258f-4cca-8ff5-410f9861a329" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.135674] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-05af2089-258f-4cca-8ff5-410f9861a329" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.136388] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05af2089-258f-4cca-8ff5-410f9861a329',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.258264] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.258665] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.258665] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.258765] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.259377] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.259377] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.259377] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.259628] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.259745] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.259745] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.259868] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d already deleted. [ 1009.259920] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.536317] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a374bf1-dcb9-4b0d-a02d-5649cc882880 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.536508] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.536555] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.536730] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.536944] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.537121] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.537197] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.537389] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.537486] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.537593] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.537943] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a374bf1-dcb9-4b0d-a02d-5649cc882880 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.537943] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.537943] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.538129] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.538296] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.538397] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.538460] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.538614] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.538678] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.538780] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.538899] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a374bf1-dcb9-4b0d-a02d-5649cc882880',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.639293] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.639293] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.639293] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.639487] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.639653] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.639800] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 05af2089-258f-4cca-8ff5-410f9861a329 not found, creating... [ 1009.640075] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.640279] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.642878] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.642878] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.642878] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.642878] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.642878] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.642878] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.642878] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.642878] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.642878] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 05af2089-258f-4cca-8ff5-410f9861a329 is going to be created. [ 1009.664892] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.665163] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.665359] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.665701] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.665997] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.666249] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-05af2089-258f-4cca-8ff5-410f9861a329" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.730563] env[66834]: INFO networking_nsxv3.common.synchronization [req-faf838d1-dabf-456e-8197-06c3588dd613 req-d354aa60-f981-4ac7-8c07-c23e19818da2 tempest-ServersTestBootFromVolume-1337405367 tempest-ServersTestBootFromVolume-1337405367-project-member] Enqueued Resource ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 with Priority: HIGHEST for action security_group_members [ 1009.731284] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 with Priority: HIGHEST for action security_group_members [ 1009.731704] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c5efb50-1e08-43fc-a6ab-e2d1db110262 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.731841] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.731948] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.732244] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.732464] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.732604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.732711] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.732928] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.733076] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.733200] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c5efb50-1e08-43fc-a6ab-e2d1db110262',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.042292] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a374bf1-dcb9-4b0d-a02d-5649cc882880: rpc.has_security_group_logging(os_id): False [ 1010.060387] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.060591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.060591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.060844] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.060932] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.061166] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.061260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.062278] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.062278] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.062278] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.062278] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.062278] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.062278] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.062278] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.062278] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.062278] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.062278] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.062787] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.062787] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.062787] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.062787] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 is going to be created. [ 1010.126065] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.126065] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.126065] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.126065] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.126065] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.139280] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 in Status: IN_PROGRESS for 2s [ 1010.235633] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.235807] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.235884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.236163] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.236258] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.236469] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.236575] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.236656] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.236826] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.236947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.237057] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 is going to be updated. [ 1010.287620] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.288057] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.288057] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.288173] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.288285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.301272] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 in Status: IN_PROGRESS for 2s [ 1010.990020] env[66834]: INFO networking_nsxv3.common.synchronization [req-4201e407-ff7b-4fa3-a914-ff37c2f49d34 req-3aaa5b27-e90b-4feb-8c5f-5a0a2a5496a5 service nova] Enqueued Resource ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d with Priority: HIGHEST for action security_group_rules [ 1010.990020] env[66834]: INFO networking_nsxv3.common.synchronization [req-4201e407-ff7b-4fa3-a914-ff37c2f49d34 req-3aaa5b27-e90b-4feb-8c5f-5a0a2a5496a5 service nova] Enqueued Resource ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d with Priority: HIGHEST for action security_group_members [ 1010.990020] env[66834]: INFO networking_nsxv3.common.synchronization [req-4201e407-ff7b-4fa3-a914-ff37c2f49d34 req-3aaa5b27-e90b-4feb-8c5f-5a0a2a5496a5 service nova] Enqueued Resource ID: 05af2089-258f-4cca-8ff5-410f9861a329 with Priority: HIGHEST for action port [ 1010.990020] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d with Priority: HIGHEST for action security_group_rules [ 1010.990020] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d with Priority: HIGHEST for action security_group_members [ 1010.992019] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05af2089-258f-4cca-8ff5-410f9861a329 with Priority: HIGHEST for action port [ 1010.992461] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0750b6a7-8358-4db0-b46f-3ccbf925625d taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.992956] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.993310] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.993975] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.993975] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0750b6a7-8358-4db0-b46f-3ccbf925625d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.996435] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-0750b6a7-8358-4db0-b46f-3ccbf925625d taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.996435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.996435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.996435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.996435] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.996435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.996435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.996435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.996435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.996435] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0750b6a7-8358-4db0-b46f-3ccbf925625d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.998916] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-05af2089-258f-4cca-8ff5-410f9861a329 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.998916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05af2089-258f-4cca-8ff5-410f9861a329" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.998916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05af2089-258f-4cca-8ff5-410f9861a329" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.999536] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05af2089-258f-4cca-8ff5-410f9861a329" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.999700] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05af2089-258f-4cca-8ff5-410f9861a329',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.217510] env[66834]: INFO networking_nsxv3.common.synchronization [req-0e164fc5-47e9-4eae-ab31-06640e650d47 req-752abc50-dbf6-40af-be17-c3bc9f183a30 tempest-ServersTestJSON-861266990 tempest-ServersTestJSON-861266990-project-member] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1011.217928] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1011.218408] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.219364] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.219364] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.219364] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.219364] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.219676] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.219676] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.219924] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.220098] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.220266] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.505587] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-0750b6a7-8358-4db0-b46f-3ccbf925625d taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.505994] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.505994] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0750b6a7-8358-4db0-b46f-3ccbf925625d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.506889] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05af2089-258f-4cca-8ff5-410f9861a329 with status ACTIVE [ 1011.507227] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.507227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.507426] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.508662] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.508662] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.508662] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.508662] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.508662] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.510400] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.510400] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.510712] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.510865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.510865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.511230] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.511932] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.512057] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05af2089-258f-4cca-8ff5-410f9861a329 is going to be updated. [ 1011.535790] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.536021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.536153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.536454] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.536737] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.536931] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05af2089-258f-4cca-8ff5-410f9861a329" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.638922] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-849 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.639138] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.639258] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.639968] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.641210] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.641210] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.641210] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.641210] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.641642] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.641642] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.641714] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1011.642477] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1011.642477] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1011.642477] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.642477] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1011.642477] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1011.669278] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1011.669622] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1011.669847] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1011.670247] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.670887] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-bafefadd-e31d-4bb2-9ca3-7010a305c606 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.671226] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-bafefadd-e31d-4bb2-9ca3-7010a305c606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.671371] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-bafefadd-e31d-4bb2-9ca3-7010a305c606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.671753] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-bafefadd-e31d-4bb2-9ca3-7010a305c606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.673192] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bafefadd-e31d-4bb2-9ca3-7010a305c606',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.722418] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.014758] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0750b6a7-8358-4db0-b46f-3ccbf925625d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.176940] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.176940] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.176940] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.176940] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.176940] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.176940] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port bafefadd-e31d-4bb2-9ca3-7010a305c606 not found, creating... [ 1012.177435] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.177678] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.177678] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.177894] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.178363] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.178445] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.178577] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.178752] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.178949] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.179123] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.179384] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: bafefadd-e31d-4bb2-9ca3-7010a305c606 is going to be created. [ 1012.196583] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 in Status: SUCCESS [ 1012.197861] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.225085] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.231946] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.232693] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.232693] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.232693] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.232974] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.233083] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-bafefadd-e31d-4bb2-9ca3-7010a305c606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.322051] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 in Status: SUCCESS [ 1012.322051] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 deletion is rescheduled due to dependency. [ 1012.322051] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.517018] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.517357] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.517405] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.517689] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.517785] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.517850] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d is going to be created. [ 1012.545252] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.545390] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.545447] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.545676] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.545858] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.560527] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d in Status: UNINITIALIZED for 2s [ 1012.727373] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.727498] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.727544] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.727910] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.728188] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.728300] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be updated. [ 1012.768363] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.768779] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.768900] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.769233] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.769348] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.781202] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 1012.920768] env[66834]: INFO networking_nsxv3.common.synchronization [req-0e164fc5-47e9-4eae-ab31-06640e650d47 req-a5ae6634-8d2e-4ae4-9e88-d0e5ae892972 service nova] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_rules [ 1012.920982] env[66834]: INFO networking_nsxv3.common.synchronization [req-0e164fc5-47e9-4eae-ab31-06640e650d47 req-a5ae6634-8d2e-4ae4-9e88-d0e5ae892972 service nova] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1012.921142] env[66834]: INFO networking_nsxv3.common.synchronization [req-0e164fc5-47e9-4eae-ab31-06640e650d47 req-a5ae6634-8d2e-4ae4-9e88-d0e5ae892972 service nova] Enqueued Resource ID: bafefadd-e31d-4bb2-9ca3-7010a305c606 with Priority: HIGHEST for action port [ 1012.921655] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_rules [ 1012.921772] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1012.921866] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bafefadd-e31d-4bb2-9ca3-7010a305c606 with Priority: HIGHEST for action port [ 1012.922283] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.922283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.922433] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.922542] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.922592] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.923475] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.923475] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.925382] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-bafefadd-e31d-4bb2-9ca3-7010a305c606 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.925382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bafefadd-e31d-4bb2-9ca3-7010a305c606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.925382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bafefadd-e31d-4bb2-9ca3-7010a305c606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.925382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bafefadd-e31d-4bb2-9ca3-7010a305c606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.925382] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bafefadd-e31d-4bb2-9ca3-7010a305c606',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.429077] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.429077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.429077] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bafefadd-e31d-4bb2-9ca3-7010a305c606 with status ACTIVE [ 1013.429077] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.429077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.429077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.429077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.429077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.429077] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.429077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.429077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.429077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.429077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.429077] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.429886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.429886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.429886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.429886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.429886] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bafefadd-e31d-4bb2-9ca3-7010a305c606 is going to be updated. [ 1013.456038] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.456038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.456038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.456038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.456038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.456038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bafefadd-e31d-4bb2-9ca3-7010a305c606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.917039] env[66834]: INFO networking_nsxv3.common.synchronization [req-f623831a-cc7a-476d-9470-d4da2f68b30e req-904e9bef-bf4e-4a62-98fd-1ee781862141 tempest-AttachVolumeNegativeTest-457073585 tempest-AttachVolumeNegativeTest-457073585-project-member] Enqueued Resource ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf with Priority: HIGHEST for action security_group_members [ 1013.917613] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf with Priority: HIGHEST for action security_group_members [ 1013.917907] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-c936d9b1-70e6-41ff-b4fc-481a320e93bf taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.921294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.921429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.921793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.922041] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.922158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.922219] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.922441] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.922550] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.923016] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c936d9b1-70e6-41ff-b4fc-481a320e93bf',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.364685] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-490 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.364888] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-490" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.365019] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-490" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.365283] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-490" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.365536] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.365686] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.365797] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.367029] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.367029] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.367029] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1014.367029] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1014.367029] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1014.367029] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1014.367029] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1014.367029] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1014.367382] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1014.390135] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1014.390238] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1014.390339] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1014.390519] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-490" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.390916] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-fb6f9609-7576-4f53-b1bd-044eac7e6b45 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.391122] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-fb6f9609-7576-4f53-b1bd-044eac7e6b45" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.391241] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-fb6f9609-7576-4f53-b1bd-044eac7e6b45" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.391577] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-fb6f9609-7576-4f53-b1bd-044eac7e6b45" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.391715] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb6f9609-7576-4f53-b1bd-044eac7e6b45',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.426392] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.426541] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.426615] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.426826] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.426919] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.427132] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.427235] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.427497] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.427497] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.427497] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.427665] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf already deleted. [ 1014.427665] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.571691] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d in Status: SUCCESS [ 1014.572455] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.572455] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.572455] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.572604] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.572666] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.572703] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.572867] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.572943] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.573045] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.573211] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0750b6a7-8358-4db0-b46f-3ccbf925625d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.780945] env[66834]: INFO networking_nsxv3.common.synchronization [None req-d5401eca-aaa9-4100-8e28-a68023d50d6d None None] Enqueued Resource ID: a4b6332f-b74d-4835-80a3-aa4a70bf9c28 with Priority: HIGHEST for action port [ 1014.781551] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4b6332f-b74d-4835-80a3-aa4a70bf9c28 with Priority: HIGHEST for action port [ 1014.782758] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4b6332f-b74d-4835-80a3-aa4a70bf9c28 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.782918] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4b6332f-b74d-4835-80a3-aa4a70bf9c28" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.782998] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4b6332f-b74d-4835-80a3-aa4a70bf9c28" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.783327] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4b6332f-b74d-4835-80a3-aa4a70bf9c28" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.783410] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4b6332f-b74d-4835-80a3-aa4a70bf9c28',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.795832] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 1014.795832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.795832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.795832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.795832] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.795832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.795832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.795832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.795832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.795832] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.894788] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.895022] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.895151] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.895427] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.895572] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.895722] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port fb6f9609-7576-4f53-b1bd-044eac7e6b45 not found, creating... [ 1014.895978] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.896140] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.896252] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.896505] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.896586] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.896860] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.897013] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.897159] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.897538] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.897697] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.897857] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: fb6f9609-7576-4f53-b1bd-044eac7e6b45 is going to be created. [ 1014.925264] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.925587] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.925666] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.925974] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.926269] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.926593] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-fb6f9609-7576-4f53-b1bd-044eac7e6b45" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.075523] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0750b6a7-8358-4db0-b46f-3ccbf925625d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.285723] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a4b6332f-b74d-4835-80a3-aa4a70bf9c28 [ 1015.285975] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.286146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.286213] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.286409] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.286493] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.286592] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a4b6332f-b74d-4835-80a3-aa4a70bf9c28 already deleted. [ 1015.286665] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4b6332f-b74d-4835-80a3-aa4a70bf9c28" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.298313] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.580213] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0750b6a7-8358-4db0-b46f-3ccbf925625d: rpc.has_security_group_logging(os_id): False [ 1015.605065] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.607314] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.607314] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.607314] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.607314] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.607314] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.607314] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.607314] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.607314] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.607314] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.607314] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d is going to be created. [ 1015.678186] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.678341] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.679526] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.680957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.680957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.694359] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d in Status: IN_PROGRESS for 2s [ 1015.752243] env[66834]: INFO networking_nsxv3.common.synchronization [req-f623831a-cc7a-476d-9470-d4da2f68b30e req-6f32702a-d511-4fa6-a557-ac63b0fceba1 service nova] Enqueued Resource ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf with Priority: HIGHEST for action security_group_rules [ 1015.752411] env[66834]: INFO networking_nsxv3.common.synchronization [req-f623831a-cc7a-476d-9470-d4da2f68b30e req-6f32702a-d511-4fa6-a557-ac63b0fceba1 service nova] Enqueued Resource ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf with Priority: HIGHEST for action security_group_members [ 1015.752546] env[66834]: INFO networking_nsxv3.common.synchronization [req-f623831a-cc7a-476d-9470-d4da2f68b30e req-6f32702a-d511-4fa6-a557-ac63b0fceba1 service nova] Enqueued Resource ID: fb6f9609-7576-4f53-b1bd-044eac7e6b45 with Priority: HIGHEST for action port [ 1015.753076] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf with Priority: HIGHEST for action security_group_rules [ 1015.753976] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf with Priority: HIGHEST for action security_group_members [ 1015.753976] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb6f9609-7576-4f53-b1bd-044eac7e6b45 with Priority: HIGHEST for action port [ 1015.753976] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c936d9b1-70e6-41ff-b4fc-481a320e93bf taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.753976] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.753976] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.753976] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.753976] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c936d9b1-70e6-41ff-b4fc-481a320e93bf',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.754843] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-c936d9b1-70e6-41ff-b4fc-481a320e93bf taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.755784] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.755901] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.756058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.756208] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.756320] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.756380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.756525] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.757236] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.757236] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c936d9b1-70e6-41ff-b4fc-481a320e93bf',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.757857] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb6f9609-7576-4f53-b1bd-044eac7e6b45 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.758067] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb6f9609-7576-4f53-b1bd-044eac7e6b45" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.758067] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb6f9609-7576-4f53-b1bd-044eac7e6b45" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.759032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb6f9609-7576-4f53-b1bd-044eac7e6b45" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.759032] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb6f9609-7576-4f53-b1bd-044eac7e6b45',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.800087] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.115222] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.115601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.115601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.116433] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.116433] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.260122] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-c936d9b1-70e6-41ff-b4fc-481a320e93bf taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.260261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.260502] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c936d9b1-70e6-41ff-b4fc-481a320e93bf',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.262609] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb6f9609-7576-4f53-b1bd-044eac7e6b45 with status ACTIVE [ 1016.262609] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.265950] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.265950] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.265950] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.265950] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.265950] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.265950] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.265950] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.265950] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.265950] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.265950] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.265950] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.265950] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.265950] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.265950] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.265950] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb6f9609-7576-4f53-b1bd-044eac7e6b45 is going to be updated. [ 1016.293623] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.293623] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.293623] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.293623] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.293623] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.293623] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb6f9609-7576-4f53-b1bd-044eac7e6b45" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.302307] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.302524] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.302585] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.302749] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.304042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.304042] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be updated. [ 1016.348160] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.350066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.350066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.350066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.350066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.367792] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 1016.620719] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.765564] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c936d9b1-70e6-41ff-b4fc-481a320e93bf',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.123117] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.268442] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.268691] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.268691] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.268923] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.269021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.269126] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf is going to be created. [ 1017.294906] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.295116] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.295116] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.295313] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.295439] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.307026] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf in Status: UNINITIALIZED for 2s [ 1017.347020] env[66834]: INFO networking_nsxv3.common.synchronization [None req-6e12a9ea-3039-4f18-95b8-ce6fed3c7f3b None None] Enqueued Resource ID: 15e799d5-6a39-42c1-bc4f-af2c2b906e99 with Priority: HIGHEST for action port [ 1017.347020] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15e799d5-6a39-42c1-bc4f-af2c2b906e99 with Priority: HIGHEST for action port [ 1017.347020] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-15e799d5-6a39-42c1-bc4f-af2c2b906e99 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.347020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15e799d5-6a39-42c1-bc4f-af2c2b906e99" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.351303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15e799d5-6a39-42c1-bc4f-af2c2b906e99" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.351303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15e799d5-6a39-42c1-bc4f-af2c2b906e99" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.351303] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15e799d5-6a39-42c1-bc4f-af2c2b906e99',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.625766] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1017.625949] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1017.725326] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d in Status: SUCCESS [ 1017.729421] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.857761] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15e799d5-6a39-42c1-bc4f-af2c2b906e99 [ 1017.857761] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.857761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.857761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.857761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.857761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.857761] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15e799d5-6a39-42c1-bc4f-af2c2b906e99 already deleted. [ 1017.857761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15e799d5-6a39-42c1-bc4f-af2c2b906e99" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.380607] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 1018.380607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.380607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.384166] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.384166] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.384166] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.384166] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.384166] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.384166] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.384166] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.384166] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.529220] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.529220] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.529220] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.529220] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.547941] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1018.549595] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.551276] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1018.584501] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.584732] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.584732] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.584987] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.594670] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.595443] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1018.595561] env[66834]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66834) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1018.595614] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1018.646818] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.647049] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.647192] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.647453] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.649382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.650088] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1018.755644] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.755820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.755904] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.756157] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.756415] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.756652] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1018.839679] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.839790] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.839790] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.840019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.840288] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.840619] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:44. [ 1018.840664] env[66834]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'386f2bfa-81a7-40ba-a9a8-a207890c2528', '68e7c2a7-894d-4c35-9c95-4f7fee507dfd', '4c5efb50-1e08-43fc-a6ab-e2d1db110262', '15d6f6bb-21e8-4682-a53e-1cc4b255699f', '9276c5a5-af43-4c6e-899f-c34039400160', 'a15c14c6-0aee-4e9d-b481-2661c510f44a', '21deb826-26b5-4246-96bf-34da6682babd', '074f3129-4b43-4c6a-91e1-f738692c4d34', '8b0294dc-2245-46bf-a56e-f22fbf616a62', '0d437be3-ac8e-4142-becb-dfc82235f8e5', 'd46470ac-aa4d-4eff-9d79-fb152af42f68', 'be6a78d7-b908-447c-a3f4-0f30c644939c', '3db0e155-352c-4d42-a24e-48fff17d86ac', 'b372a601-425a-4557-bfbf-2682fc337d0d', '3ce997a4-e173-41da-a149-86945dba84fe', '9c3590f1-016a-4b00-b83e-f52f030b948b', '4a374bf1-dcb9-4b0d-a02d-5649cc882880', '2989937c-6050-493e-a1d8-79a52d9b6132', '3ac1b684-ee07-41f3-926b-106a37b82e05', '0499d8ef-26b2-4caa-99c4-df9d91f4f626', '482d0336-6e92-4922-86a3-e6d489211f48', '4cdb75fc-c0b5-4b9d-843f-f2ae58af6997', 'b11bc7eb-c1bb-49d4-8347-38576752a094', '599d582a-c0d7-4df7-a1fe-3e63412d8939', '782e10e2-c275-4c7b-bb67-ec47dc30cf73', '1262896d-5f2c-4d6b-8695-adeea78ba3f6', '1c88662f-4694-4988-b716-56b85d22f3c9', '87920817-9bc0-40b2-945a-8057b5158162', '06251551-417e-4f8a-9412-fdb5036f57fe', '0750b6a7-8358-4db0-b46f-3ccbf925625d', 'a4da628c-f2f0-417c-917f-a8cc4350870b', 'c40be9d7-369b-4cf1-88e7-d822d62fa7f1', '98a1f729-8e05-4426-8db7-2c883443f0e8', '8ef26513-917e-4754-b69d-1d511bcb585b', '7b33fa48-b9ca-426c-b890-67d4639035e2', '659c3ecb-b49f-4d7f-8978-4e0221530e96', '6b93eb01-51cc-4c25-b2fa-56b4a62620d3', '06c1d39f-c76e-47c4-9900-046863c4e37a', 'f46326b4-7843-4c05-8eca-cb73edd99c30', '61dc46c7-365b-480f-83e5-16cbc578a879', 'e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c', '4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4', '7963c125-23b5-45fd-8158-f6470d12949e', '673eef00-b174-4a71-a870-466f27b577fd'} {{(pid=66834) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1018.840883] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1018.865968] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.866172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.866172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.866301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.866382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.866533] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1018.866680] env[66834]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66834) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1018.866818] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1018.884136] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.884351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.884351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.884540] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.884706] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.884805] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.884867] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.885030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.885118] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.885203] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.885347] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.885436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.885484] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.885628] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.885778] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.885869] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.885949] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.886228] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.887273] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.887650] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.887827] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.970187] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.970187] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.970187] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.970187] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.970187] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.970187] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1018.970187] env[66834]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66834) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1018.970187] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1018.970187] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1018.970187] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/44 resources of Type:Security Group Rules [ 1018.970187] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 with Priority: HIGH for action security_group_rules [ 1018.970187] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd with Priority: HIGH for action security_group_rules [ 1018.970187] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 with Priority: HIGH for action security_group_rules [ 1018.970802] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGH for action security_group_rules [ 1018.971049] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGH for action security_group_rules [ 1018.971245] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGH for action security_group_rules [ 1018.971406] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGH for action security_group_rules [ 1018.971557] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 with Priority: HIGH for action security_group_rules [ 1018.971704] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 with Priority: HIGH for action security_group_rules [ 1018.971851] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 with Priority: HIGH for action security_group_rules [ 1018.972050] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d46470ac-aa4d-4eff-9d79-fb152af42f68 with Priority: HIGH for action security_group_rules [ 1018.972205] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: be6a78d7-b908-447c-a3f4-0f30c644939c with Priority: HIGH for action security_group_rules [ 1018.972372] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3db0e155-352c-4d42-a24e-48fff17d86ac with Priority: HIGH for action security_group_rules [ 1018.972530] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b372a601-425a-4557-bfbf-2682fc337d0d with Priority: HIGH for action security_group_rules [ 1018.972681] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGH for action security_group_rules [ 1018.972837] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9c3590f1-016a-4b00-b83e-f52f030b948b with Priority: HIGH for action security_group_rules [ 1018.972985] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 with Priority: HIGH for action security_group_rules [ 1018.973168] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGH for action security_group_rules [ 1018.973633] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 with Priority: HIGH for action security_group_rules [ 1018.973816] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0499d8ef-26b2-4caa-99c4-df9d91f4f626 with Priority: HIGH for action security_group_rules [ 1018.974207] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.324379] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf in Status: SUCCESS [ 1019.324970] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.325633] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.326906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.326906] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.326906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.326906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.327261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.327302] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.328439] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.328439] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c936d9b1-70e6-41ff-b4fc-481a320e93bf',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.390826] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c88662f-4694-4988-b716-56b85d22f3c9: rpc.has_security_group_logging(os_id): False [ 1019.411612] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.411612] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.411612] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.411837] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.453036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.455517] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.455517] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.455517] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.455517] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.455517] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.455517] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.455517] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.455517] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.455924] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.455924] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.455924] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.455924] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.456099] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.458228] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.458228] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.458228] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be updated. [ 1019.529959] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.529959] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.529959] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.529959] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.529959] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.545968] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 1019.830730] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c936d9b1-70e6-41ff-b4fc-481a320e93bf',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.334361] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c936d9b1-70e6-41ff-b4fc-481a320e93bf: rpc.has_security_group_logging(os_id): False [ 1020.354503] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.354658] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.354728] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.354968] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.356144] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.356695] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.357186] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.357186] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.357313] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.357407] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.357520] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf is going to be created. [ 1020.444272] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.444272] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.444272] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.444272] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.444272] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.458177] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf in Status: IN_PROGRESS for 2s [ 1020.956938] env[66834]: INFO networking_nsxv3.common.synchronization [req-c556b9e7-caef-4f2a-be9d-702894faaa20 req-c45fc696-e6cf-417c-9cc8-685003e3f043 tempest-ServersAdminTestJSON-835845617 tempest-ServersAdminTestJSON-835845617-project-member] Enqueued Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_members [ 1020.957869] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGHEST for action security_group_members [ 1020.958012] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 with Priority: HIGH for action security_group_rules [ 1020.958185] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 with Priority: HIGH for action security_group_rules [ 1020.958325] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21deb826-26b5-4246-96bf-34da6682babd with Priority: HIGH for action security_group_rules [ 1020.958449] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ce997a4-e173-41da-a149-86945dba84fe with Priority: HIGH for action security_group_rules [ 1020.958654] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0499d8ef-26b2-4caa-99c4-df9d91f4f626 with Priority: HIGH for action security_group_rules [ 1020.958775] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 with Priority: HIGH for action security_group_rules [ 1020.958905] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGH for action security_group_rules [ 1020.959012] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 with Priority: HIGH for action security_group_rules [ 1020.959109] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b372a601-425a-4557-bfbf-2682fc337d0d with Priority: HIGH for action security_group_rules [ 1020.959212] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c3590f1-016a-4b00-b83e-f52f030b948b with Priority: HIGH for action security_group_rules [ 1020.959688] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3db0e155-352c-4d42-a24e-48fff17d86ac with Priority: HIGH for action security_group_rules [ 1020.959797] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be6a78d7-b908-447c-a3f4-0f30c644939c with Priority: HIGH for action security_group_rules [ 1020.959907] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46470ac-aa4d-4eff-9d79-fb152af42f68 with Priority: HIGH for action security_group_rules [ 1020.960034] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 with Priority: HIGH for action security_group_rules [ 1020.960134] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 with Priority: HIGH for action security_group_rules [ 1020.960223] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGH for action security_group_rules [ 1020.960325] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 with Priority: HIGH for action security_group_rules [ 1020.960411] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9276c5a5-af43-4c6e-899f-c34039400160 with Priority: HIGH for action security_group_rules [ 1020.960522] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd with Priority: HIGH for action security_group_rules [ 1020.960593] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f with Priority: HIGH for action security_group_rules [ 1020.961050] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.961203] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.961260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.961502] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.961696] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.961837] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.961925] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.962276] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.962276] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.962396] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.963593] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-386f2bfa-81a7-40ba-a9a8-a207890c2528 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.963724] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.963793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.963970] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.964075] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('386f2bfa-81a7-40ba-a9a8-a207890c2528',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.966125] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c5efb50-1e08-43fc-a6ab-e2d1db110262 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.966125] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.966125] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.966125] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.966125] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c5efb50-1e08-43fc-a6ab-e2d1db110262',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.966860] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21deb826-26b5-4246-96bf-34da6682babd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.967998] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.967998] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.967998] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.967998] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21deb826-26b5-4246-96bf-34da6682babd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.968532] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ce997a4-e173-41da-a149-86945dba84fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.968675] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.968728] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.968849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.968916] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ce997a4-e173-41da-a149-86945dba84fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.969646] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0499d8ef-26b2-4caa-99c4-df9d91f4f626 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.969760] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.969809] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.970507] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.970507] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0499d8ef-26b2-4caa-99c4-df9d91f4f626',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.971028] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ac1b684-ee07-41f3-926b-106a37b82e05 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.971200] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.971250] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.971672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.971672] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ac1b684-ee07-41f3-926b-106a37b82e05',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.973313] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.973313] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.973313] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.973313] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.973313] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.975150] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a374bf1-dcb9-4b0d-a02d-5649cc882880 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.975150] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.975150] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.975150] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.975150] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a374bf1-dcb9-4b0d-a02d-5649cc882880',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.975970] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b372a601-425a-4557-bfbf-2682fc337d0d taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.976145] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.976239] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.976537] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.976622] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b372a601-425a-4557-bfbf-2682fc337d0d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.978443] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c3590f1-016a-4b00-b83e-f52f030b948b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.978443] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.978443] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.978443] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.978443] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c3590f1-016a-4b00-b83e-f52f030b948b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.980026] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3db0e155-352c-4d42-a24e-48fff17d86ac taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.980026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.980026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.980026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.980026] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3db0e155-352c-4d42-a24e-48fff17d86ac',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.981629] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be6a78d7-b908-447c-a3f4-0f30c644939c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.981629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.981629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.981629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.981629] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be6a78d7-b908-447c-a3f4-0f30c644939c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.982058] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d46470ac-aa4d-4eff-9d79-fb152af42f68 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.982058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.982058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.982058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.982232] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d46470ac-aa4d-4eff-9d79-fb152af42f68',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.983476] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d437be3-ac8e-4142-becb-dfc82235f8e5 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.983594] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.983706] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.983862] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.983934] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d437be3-ac8e-4142-becb-dfc82235f8e5',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.985123] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b0294dc-2245-46bf-a56e-f22fbf616a62 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.985262] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.985340] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.985543] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.985594] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b0294dc-2245-46bf-a56e-f22fbf616a62',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.986384] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.986503] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.986576] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.986740] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.986828] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.987854] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-074f3129-4b43-4c6a-91e1-f738692c4d34 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.987854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.988018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.988086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.988205] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('074f3129-4b43-4c6a-91e1-f738692c4d34',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.988969] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9276c5a5-af43-4c6e-899f-c34039400160 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.989242] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.989242] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.989432] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.989469] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9276c5a5-af43-4c6e-899f-c34039400160',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.991077] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68e7c2a7-894d-4c35-9c95-4f7fee507dfd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.991077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.991077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.991077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.991077] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68e7c2a7-894d-4c35-9c95-4f7fee507dfd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.991995] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15d6f6bb-21e8-4682-a53e-1cc4b255699f taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.991995] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.991995] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.992296] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.992296] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15d6f6bb-21e8-4682-a53e-1cc4b255699f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.992590] env[66834]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 1021.000219] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.000351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.000424] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.000641] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.035050] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.035281] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.040987] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.041263] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.041386] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.041455] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.041659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.041739] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.041830] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9276c5a5-af43-4c6e-899f-c34039400160 is going to be updated. [ 1021.043258] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.043813] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.066409] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.066556] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 386f2bfa-81a7-40ba-a9a8-a207890c2528 is going to be deleted. [ 1021.090063] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.090063] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.090063] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.090063] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.090063] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.101889] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: IN_PROGRESS for 2s [ 1021.148659] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.148659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.149199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.149199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.149199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.149551] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-386f2bfa-81a7-40ba-a9a8-a207890c2528" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.496691] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a374bf1-dcb9-4b0d-a02d-5649cc882880 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.497136] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.497136] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.497136] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.497276] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.497346] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.497403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.497554] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.497662] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.497751] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.497836] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a374bf1-dcb9-4b0d-a02d-5649cc882880',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.505025] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d437be3-ac8e-4142-becb-dfc82235f8e5 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.505025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.505025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.505025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.505025] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.505025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.505025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.505025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.505025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.505025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.505025] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d437be3-ac8e-4142-becb-dfc82235f8e5',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.518439] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ac1b684-ee07-41f3-926b-106a37b82e05 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.518439] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.518439] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.518793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.519139] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.520555] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.520555] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.520555] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.520555] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.520555] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.520555] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ac1b684-ee07-41f3-926b-106a37b82e05',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.593310] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.593511] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.593511] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.593708] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.598179] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.598179] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.598179] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.598179] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.598481] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.598587] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.599464] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.599602] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.600696] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.600696] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.602160] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.602268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.603745] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.603745] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.604715] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.604715] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.605546] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.605765] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.606634] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.606758] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.607419] env[66834]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1021.607957] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.608096] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.609738] env[66834]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1021.609738] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.609738] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.610451] env[66834]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1021.611228] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.611228] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.612207] env[66834]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1021.612366] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.612504] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.613309] env[66834]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1021.614199] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 1021.614199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.614617] env[66834]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1021.615097] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.615250] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.619940] env[66834]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1021.620677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.620903] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ce997a4-e173-41da-a149-86945dba84fe is going to be deleted. [ 1021.622238] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.622659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.651341] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.651595] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21deb826-26b5-4246-96bf-34da6682babd is going to be deleted. [ 1021.652860] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.653226] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.689559] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.689958] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 074f3129-4b43-4c6a-91e1-f738692c4d34 is going to be deleted. [ 1021.690736] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.691051] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.707290] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.707465] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.718852] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.719380] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d46470ac-aa4d-4eff-9d79-fb152af42f68 is going to be deleted. [ 1021.720113] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.720362] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.778528] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.778959] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b372a601-425a-4557-bfbf-2682fc337d0d is going to be deleted. [ 1021.780315] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.780577] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.832306] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.832493] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.833279] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.833396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.846468] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.846684] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b0294dc-2245-46bf-a56e-f22fbf616a62 is going to be deleted. [ 1021.852244] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.852673] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.906404] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.906632] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.927462] env[66834]: INFO networking_nsxv3.common.synchronization [None req-dee632f3-e96c-4b7b-8357-cc37a4388a26 tempest-AttachInterfacesTestJSON-77868371 tempest-AttachInterfacesTestJSON-77868371-project-member] Enqueued Resource ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 with Priority: HIGHEST for action security_group_rules [ 1021.927462] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 with Priority: HIGHEST for action security_group_rules [ 1021.927462] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac8e3a64-d540-43bb-a864-6d42bf3a44c4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.927628] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.927628] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.927857] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.928185] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac8e3a64-d540-43bb-a864-6d42bf3a44c4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.943532] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.943693] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0499d8ef-26b2-4caa-99c4-df9d91f4f626 is going to be deleted. [ 1021.945531] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.946688] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.008241] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a374bf1-dcb9-4b0d-a02d-5649cc882880 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.008494] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.008574] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.008820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.009061] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.009184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.009246] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.009443] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.009660] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.009764] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.009989] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a374bf1-dcb9-4b0d-a02d-5649cc882880 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.010143] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.010143] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.010312] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.010442] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.010541] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.010603] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.010735] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.011023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.011023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.011023] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a374bf1-dcb9-4b0d-a02d-5649cc882880',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.026728] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.026908] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15d6f6bb-21e8-4682-a53e-1cc4b255699f is going to be deleted. [ 1022.027845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.028126] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.033279] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d437be3-ac8e-4142-becb-dfc82235f8e5',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.033279] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ac1b684-ee07-41f3-926b-106a37b82e05',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.142200] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.142200] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.149901] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.150106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.156388] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.156548] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be deleted. [ 1022.157770] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.157770] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.157997] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.157997] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9276c5a5-af43-4c6e-899f-c34039400160 is going to be deleted. [ 1022.158938] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.159252] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.183056] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.183056] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.202918] env[66834]: INFO networking_nsxv3.common.synchronization [None req-7b0b7ca5-13bb-44a1-a03e-750a0351a2ba tempest-AttachInterfacesTestJSON-77868371 tempest-AttachInterfacesTestJSON-77868371-project-member] Enqueued Resource ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 with Priority: HIGHEST for action security_group_rules [ 1022.203934] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 with Priority: HIGHEST for action security_group_rules [ 1022.204510] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac8e3a64-d540-43bb-a864-6d42bf3a44c4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.204688] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.222354] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.222473] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c3590f1-016a-4b00-b83e-f52f030b948b is going to be deleted. [ 1022.223618] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.223912] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.297395] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.297541] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.305859] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.305859] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2989937c-6050-493e-a1d8-79a52d9b6132 is going to be deleted. [ 1022.307046] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.307293] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.350773] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.350976] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.353912] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.353912] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.373530] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.373530] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c5efb50-1e08-43fc-a6ab-e2d1db110262 is going to be deleted. [ 1022.374750] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.374898] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.419949] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.419949] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be6a78d7-b908-447c-a3f4-0f30c644939c is going to be deleted. [ 1022.420994] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.421440] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.431660] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.431954] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.448964] env[66834]: INFO networking_nsxv3.common.synchronization [None req-59e37509-df74-49fd-a950-b6e2ee277cc9 None None] Enqueued Resource ID: 08f2e39a-094c-44d8-babd-89edc1e2df9e with Priority: HIGHEST for action port [ 1022.449676] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08f2e39a-094c-44d8-babd-89edc1e2df9e with Priority: HIGHEST for action port [ 1022.450022] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-08f2e39a-094c-44d8-babd-89edc1e2df9e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.450727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08f2e39a-094c-44d8-babd-89edc1e2df9e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.450898] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08f2e39a-094c-44d8-babd-89edc1e2df9e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.451348] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08f2e39a-094c-44d8-babd-89edc1e2df9e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.451558] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08f2e39a-094c-44d8-babd-89edc1e2df9e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.504552] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.504552] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.508697] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.508916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.511515] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.511649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.516102] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a374bf1-dcb9-4b0d-a02d-5649cc882880: rpc.has_security_group_logging(os_id): False [ 1022.529251] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf in Status: SUCCESS [ 1022.529486] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.535057] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d437be3-ac8e-4142-becb-dfc82235f8e5: rpc.has_security_group_logging(os_id): False [ 1022.538947] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ac1b684-ee07-41f3-926b-106a37b82e05: rpc.has_security_group_logging(os_id): False [ 1022.541153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.541309] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68e7c2a7-894d-4c35-9c95-4f7fee507dfd is going to be deleted. [ 1022.542180] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.542370] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.592719] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.592719] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.593981] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.594333] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.601347] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.601347] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.611033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.611033] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3db0e155-352c-4d42-a24e-48fff17d86ac is going to be deleted. [ 1022.611033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.611033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.611033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.611033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ce997a4-e173-41da-a149-86945dba84fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.611033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.611033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.611033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.611710] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21deb826-26b5-4246-96bf-34da6682babd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.612417] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.612862] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.613152] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.613393] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d46470ac-aa4d-4eff-9d79-fb152af42f68" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.613642] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.613885] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.614103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.614326] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-074f3129-4b43-4c6a-91e1-f738692c4d34" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.616028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.616028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.616028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.616028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b0294dc-2245-46bf-a56e-f22fbf616a62" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.616028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.616028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.616028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.616028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b372a601-425a-4557-bfbf-2682fc337d0d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.616028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.616397] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.616461] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.616582] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0499d8ef-26b2-4caa-99c4-df9d91f4f626" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.616961] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.617184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.617277] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.617406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.618027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.618027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.618027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.618275] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15d6f6bb-21e8-4682-a53e-1cc4b255699f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.618275] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.618407] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.618477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.618587] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.618775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.618933] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.618933] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.619058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c3590f1-016a-4b00-b83e-f52f030b948b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.619202] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.619311] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.619437] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.619500] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.619602] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.619738] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.620478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.620478] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 already deleted. [ 1022.620478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.620478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.620478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.620478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.620478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c5efb50-1e08-43fc-a6ab-e2d1db110262" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.620947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.620947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.620947] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac8e3a64-d540-43bb-a864-6d42bf3a44c4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.622277] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.622452] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.641959] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.642317] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.693819] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.694562] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.718785] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.719183] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.719327] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.719428] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.719658] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.719743] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.719851] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 is going to be updated. [ 1022.721262] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.721499] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.832714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.833462] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.833633] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.833795] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.834174] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.834358] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.834573] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 is going to be updated. [ 1022.838463] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.838969] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.839208] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.839478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be6a78d7-b908-447c-a3f4-0f30c644939c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.839741] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.842425] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.842663] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.842929] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68e7c2a7-894d-4c35-9c95-4f7fee507dfd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.843249] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.843556] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.855922] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.856990] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.902815] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.903171] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.903499] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.903499] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.903691] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.903797] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.904035] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.908536] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.908702] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.909085] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.909085] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.909348] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.909448] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.909512] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.909678] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.909757] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.909847] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 is going to be updated. [ 1022.911564] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.911564] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.911564] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.911564] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3db0e155-352c-4d42-a24e-48fff17d86ac" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.955277] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08f2e39a-094c-44d8-babd-89edc1e2df9e [ 1022.959260] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.959462] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.959520] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.959760] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.959852] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.959960] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08f2e39a-094c-44d8-babd-89edc1e2df9e already deleted. [ 1022.960069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08f2e39a-094c-44d8-babd-89edc1e2df9e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.978735] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.979093] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.979093] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.979202] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.979348] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.015262] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.015518] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.015634] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.015901] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.016069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.023179] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 in Status: IN_PROGRESS for 2s [ 1023.058920] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 in Status: IN_PROGRESS for 2s [ 1023.078323] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.078323] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.078323] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.078323] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.078323] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.105750] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 in Status: IN_PROGRESS for 2s [ 1023.125299] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9276c5a5-af43-4c6e-899f-c34039400160 in Status: SUCCESS [ 1023.125644] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9276c5a5-af43-4c6e-899f-c34039400160 deletion is rescheduled due to dependency. [ 1023.125644] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9276c5a5-af43-4c6e-899f-c34039400160" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.179101] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.180906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.180906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.180906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.180906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.180906] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 already deleted. [ 1023.180906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.988712] env[66834]: INFO networking_nsxv3.common.synchronization [None req-8c7fe4d9-83c8-4178-9183-5cd01bf8f5c7 None None] Enqueued Resource ID: df93d78b-85cf-4f47-9d51-0784bfea7be3 with Priority: HIGHEST for action port [ 1024.988712] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df93d78b-85cf-4f47-9d51-0784bfea7be3 with Priority: HIGHEST for action port [ 1024.988712] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-df93d78b-85cf-4f47-9d51-0784bfea7be3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.989043] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df93d78b-85cf-4f47-9d51-0784bfea7be3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.989043] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df93d78b-85cf-4f47-9d51-0784bfea7be3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.989307] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df93d78b-85cf-4f47-9d51-0784bfea7be3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.989408] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df93d78b-85cf-4f47-9d51-0784bfea7be3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.040840] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 in Status: SUCCESS [ 1025.040840] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.075016] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 in Status: SUCCESS [ 1025.075016] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.122892] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 in Status: SUCCESS [ 1025.123249] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.492697] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df93d78b-85cf-4f47-9d51-0784bfea7be3 [ 1025.492814] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.492886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.492928] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.493162] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.493758] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.493758] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df93d78b-85cf-4f47-9d51-0784bfea7be3 already deleted. [ 1025.493758] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df93d78b-85cf-4f47-9d51-0784bfea7be3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.116164] env[66834]: INFO networking_nsxv3.common.synchronization [req-ce0092fe-2008-48cf-88de-155465e21250 req-29850de2-e4fd-4789-a66f-3cd065692a6a tempest-ServersTestMultiNic-565362409 tempest-ServersTestMultiNic-565362409-project-member] Enqueued Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1026.116923] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1026.117847] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.118112] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.118225] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.119813] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.120111] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.120277] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.120382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.120604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.120720] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.120850] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.556440] env[66834]: INFO networking_nsxv3.common.synchronization [req-ce0092fe-2008-48cf-88de-155465e21250 req-72870c0d-d951-4549-8d89-a183d10079d6 tempest-ServersTestMultiNic-565362409 tempest-ServersTestMultiNic-565362409-project-member] Enqueued Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1026.556987] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1026.557441] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.557548] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.623350] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.623573] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.623666] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.623879] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.623984] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.624208] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.624332] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.624403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.624589] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.624668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.624758] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b already deleted. [ 1026.624835] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.625074] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.625221] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.625362] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.625453] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.625535] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.625645] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.625738] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.625869] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.019063] env[66834]: INFO networking_nsxv3.common.synchronization [req-ce0092fe-2008-48cf-88de-155465e21250 req-25cf4829-496a-4a94-b7b9-1dba05202827 tempest-ServersTestMultiNic-565362409 tempest-ServersTestMultiNic-565362409-project-member] Enqueued Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1027.019660] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1027.020018] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.020292] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.128140] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.128486] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.128486] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.128643] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.128736] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.128971] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.129090] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.129155] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.129312] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.129404] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.129492] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b already deleted. [ 1027.129574] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.130470] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.130470] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.130470] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.130470] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.130470] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.130470] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.130470] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.130868] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.434506] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-595 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.434705] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-595" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.434803] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-595" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.435133] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-595" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.435385] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.435538] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.435711] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.435917] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.436121] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.436363] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1027.436419] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1027.436528] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1027.436651] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1027.436806] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1027.436885] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1027.437031] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1027.459799] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.460319] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1027.460319] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.460319] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-595" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.460699] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-f970e742-a7dd-4233-93a3-6e3fdbaca217 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.460871] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-f970e742-a7dd-4233-93a3-6e3fdbaca217" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.461042] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-f970e742-a7dd-4233-93a3-6e3fdbaca217" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.461360] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-f970e742-a7dd-4233-93a3-6e3fdbaca217" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.461494] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f970e742-a7dd-4233-93a3-6e3fdbaca217',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.610773] env[66834]: INFO networking_nsxv3.common.synchronization [req-45702b9a-5799-4544-a391-85e2c041d664 req-ad26ccf1-bece-466c-a538-b192d213eb15 tempest-ServerDiskConfigTestJSON-362503924 tempest-ServerDiskConfigTestJSON-362503924-project-member] Enqueued Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 1027.611344] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 1027.611857] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.611997] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.612301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.612395] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.612522] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.612622] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.612677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.612840] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.612922] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.613024] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.633154] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.633299] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.633391] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.633599] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.633687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.633876] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.633977] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.634052] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.634205] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.634281] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.634366] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b already deleted. [ 1027.634444] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.966762] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.967079] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.967214] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.967484] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.968056] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.968056] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port f970e742-a7dd-4233-93a3-6e3fdbaca217 not found, creating... [ 1027.968162] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.968319] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.968428] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.969217] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.969476] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.969682] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.969911] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.970279] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.970550] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.970741] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.970891] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: f970e742-a7dd-4233-93a3-6e3fdbaca217 is going to be created. [ 1027.992195] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.992456] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.992678] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.993039] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.993351] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.993669] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-f970e742-a7dd-4233-93a3-6e3fdbaca217" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.115293] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.115557] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.115557] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.115725] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.140858] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.141329] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.141456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.141456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.141656] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.141739] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.141826] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7963c125-23b5-45fd-8158-f6470d12949e is going to be updated. [ 1028.184086] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.184313] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.184455] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.184833] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.185084] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.195917] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: IN_PROGRESS for 2s [ 1028.288491] env[66834]: INFO networking_nsxv3.common.synchronization [req-e31c4714-48a4-4f55-8202-c5c8c3d2bf04 req-8f855187-b239-4e73-a0a3-236f8a2ce57c tempest-DeleteServersTestJSON-1250802255 tempest-DeleteServersTestJSON-1250802255-project-member] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 1028.288887] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 1028.289531] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.289531] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.289531] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.289906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.290098] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.290273] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.290391] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.292101] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.292101] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.292101] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.688245] env[66834]: INFO networking_nsxv3.common.synchronization [req-ce0092fe-2008-48cf-88de-155465e21250 req-a39e1cc6-1d1e-42bb-bb74-0f52f181c86a service nova] Enqueued Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_rules [ 1028.688245] env[66834]: INFO networking_nsxv3.common.synchronization [req-ce0092fe-2008-48cf-88de-155465e21250 req-a39e1cc6-1d1e-42bb-bb74-0f52f181c86a service nova] Enqueued Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1028.688245] env[66834]: INFO networking_nsxv3.common.synchronization [req-ce0092fe-2008-48cf-88de-155465e21250 req-a39e1cc6-1d1e-42bb-bb74-0f52f181c86a service nova] Enqueued Resource ID: f970e742-a7dd-4233-93a3-6e3fdbaca217 with Priority: HIGHEST for action port [ 1028.688245] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_rules [ 1028.690994] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1028.690994] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f970e742-a7dd-4233-93a3-6e3fdbaca217 with Priority: HIGHEST for action port [ 1028.692123] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-606 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.692330] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.692449] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.692707] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.692974] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.693275] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.693418] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.693690] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.694307] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.694653] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1028.694888] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1028.696139] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1028.696334] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1028.697059] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1028.697059] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1028.697059] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1028.699101] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.699255] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.699255] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.699809] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.699809] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.701098] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.701223] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.701283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.701470] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.701633] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.701781] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.701781] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.701930] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.702060] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.702240] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.703464] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-f970e742-a7dd-4233-93a3-6e3fdbaca217 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.703464] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f970e742-a7dd-4233-93a3-6e3fdbaca217" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.703464] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f970e742-a7dd-4233-93a3-6e3fdbaca217" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.703785] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f970e742-a7dd-4233-93a3-6e3fdbaca217" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.703785] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f970e742-a7dd-4233-93a3-6e3fdbaca217',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.734518] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1028.734738] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1028.734793] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1028.735056] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.735398] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-abd65798-c300-4ef2-aada-119bb5ca01ee taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.735622] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-abd65798-c300-4ef2-aada-119bb5ca01ee" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.735749] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-abd65798-c300-4ef2-aada-119bb5ca01ee" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.736152] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-abd65798-c300-4ef2-aada-119bb5ca01ee" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.736328] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abd65798-c300-4ef2-aada-119bb5ca01ee',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.794133] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.794302] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.794376] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.794620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.794778] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.794919] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.795042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.795106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.795273] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.795421] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.795500] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be deleted. [ 1028.831450] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.831697] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.831753] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.832098] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.832221] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.832283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.896338] env[66834]: INFO networking_nsxv3.common.synchronization [req-b28eeeed-0812-4e57-943f-4537abfadcd0 req-f33145e9-b2de-4852-92fe-9b15b7633034 tempest-ServersTestJSON-861266990 tempest-ServersTestJSON-861266990-project-member] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1028.896584] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1028.896887] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.897113] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.897113] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.897369] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.897445] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.897523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.897736] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.897736] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.897818] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.897886] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.205416] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.206693] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.206889] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.207043] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f970e742-a7dd-4233-93a3-6e3fdbaca217 with status ACTIVE [ 1029.207323] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.207450] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.207529] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.207748] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.207914] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.208176] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.208305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.208373] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.209658] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.209658] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.209658] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.209658] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.209658] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.209658] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.209658] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.209658] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f970e742-a7dd-4233-93a3-6e3fdbaca217 is going to be updated. [ 1029.239407] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.239656] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.239783] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.240089] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.240252] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.240406] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port abd65798-c300-4ef2-aada-119bb5ca01ee not found, creating... [ 1029.240678] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.240837] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.241026] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.241307] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.241447] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.241741] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.241896] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.242051] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.242241] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.242378] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.242513] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: abd65798-c300-4ef2-aada-119bb5ca01ee is going to be created. [ 1029.269401] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.269711] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.269711] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.269855] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.269983] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.270185] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f970e742-a7dd-4233-93a3-6e3fdbaca217" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.271421] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.271612] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.271732] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.272064] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.272306] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.272538] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-abd65798-c300-4ef2-aada-119bb5ca01ee" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.400652] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.712129] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.903292] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.975390] env[66834]: INFO networking_nsxv3.common.synchronization [req-e31c4714-48a4-4f55-8202-c5c8c3d2bf04 req-44898c75-1f7c-4875-b842-8b0e3fe47d5c service nova] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_rules [ 1029.975611] env[66834]: INFO networking_nsxv3.common.synchronization [req-e31c4714-48a4-4f55-8202-c5c8c3d2bf04 req-44898c75-1f7c-4875-b842-8b0e3fe47d5c service nova] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 1029.975809] env[66834]: INFO networking_nsxv3.common.synchronization [req-e31c4714-48a4-4f55-8202-c5c8c3d2bf04 req-44898c75-1f7c-4875-b842-8b0e3fe47d5c service nova] Enqueued Resource ID: abd65798-c300-4ef2-aada-119bb5ca01ee with Priority: HIGHEST for action port [ 1029.976326] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_rules [ 1029.976823] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 1029.976866] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abd65798-c300-4ef2-aada-119bb5ca01ee with Priority: HIGHEST for action port [ 1029.978336] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.978336] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.978336] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.978336] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.978336] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.979147] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.979698] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.979769] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.980137] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.980611] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.980893] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.981312] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.982798] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.982798] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.982798] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.983591] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-abd65798-c300-4ef2-aada-119bb5ca01ee taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.984333] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abd65798-c300-4ef2-aada-119bb5ca01ee" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.984617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abd65798-c300-4ef2-aada-119bb5ca01ee" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.984794] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abd65798-c300-4ef2-aada-119bb5ca01ee" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.985156] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abd65798-c300-4ef2-aada-119bb5ca01ee',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.207577] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: SUCCESS [ 1030.207949] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7963c125-23b5-45fd-8158-f6470d12949e deletion is rescheduled due to dependency. [ 1030.207949] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.214521] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.215943] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.215943] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.215943] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.215943] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.215943] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b is going to be created. [ 1030.241137] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.241385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.241385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.241601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.241822] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.252313] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: UNINITIALIZED for 2s [ 1030.326682] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-524 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.326953] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-524" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.327021] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-524" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.327365] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-524" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.327643] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.327806] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.327920] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.328280] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.328405] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.328623] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1030.329286] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1030.329423] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1030.329535] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1030.329653] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1030.329758] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1030.329891] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1030.349261] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1030.349416] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1030.349553] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1030.349732] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-524" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.350064] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-5daf8090-4819-4703-9774-1323bfb57418 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.350244] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-5daf8090-4819-4703-9774-1323bfb57418" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.350361] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-5daf8090-4819-4703-9774-1323bfb57418" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.350692] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-5daf8090-4819-4703-9774-1323bfb57418" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.350828] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5daf8090-4819-4703-9774-1323bfb57418',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.408391] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.408555] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.408621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.410496] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.410496] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.410496] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be updated. [ 1030.443027] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.443027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.443027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.443027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.443027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.452875] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 1030.490029] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.490029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.490029] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.490029] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port abd65798-c300-4ef2-aada-119bb5ca01ee with status ACTIVE [ 1030.490029] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.490029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.490029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.490029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.490029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.490029] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.490029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.491153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.492351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.492351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.492351] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.492779] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.493064] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.495267] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.495267] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.495267] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: abd65798-c300-4ef2-aada-119bb5ca01ee is going to be updated. [ 1030.519509] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.519509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.519509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.519509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.519509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.519509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abd65798-c300-4ef2-aada-119bb5ca01ee" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.853574] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.853800] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.853901] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.854225] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.854385] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.854539] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 5daf8090-4819-4703-9774-1323bfb57418 not found, creating... [ 1030.854808] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.854808] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.855151] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.855326] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.855459] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.855736] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.855885] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.856035] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.856262] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.856414] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.856564] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 5daf8090-4819-4703-9774-1323bfb57418 is going to be created. [ 1030.879368] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.879632] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.879745] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.880058] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.880317] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.880579] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-5daf8090-4819-4703-9774-1323bfb57418" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.996594] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.499192] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.499570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.500045] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.500045] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.500045] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.500212] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be created. [ 1031.527429] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.527642] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.527716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.527934] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.528311] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.539569] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: UNINITIALIZED for 2s [ 1031.594526] env[66834]: INFO networking_nsxv3.common.synchronization [req-ce0092fe-2008-48cf-88de-155465e21250 req-f8e2332a-c203-4aa4-a8ef-88aeb52f5e88 service nova] Enqueued Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_rules [ 1031.594704] env[66834]: INFO networking_nsxv3.common.synchronization [req-ce0092fe-2008-48cf-88de-155465e21250 req-f8e2332a-c203-4aa4-a8ef-88aeb52f5e88 service nova] Enqueued Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1031.594837] env[66834]: INFO networking_nsxv3.common.synchronization [req-ce0092fe-2008-48cf-88de-155465e21250 req-f8e2332a-c203-4aa4-a8ef-88aeb52f5e88 service nova] Enqueued Resource ID: 5daf8090-4819-4703-9774-1323bfb57418 with Priority: HIGHEST for action port [ 1031.595480] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_rules [ 1031.595572] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1031.595669] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5daf8090-4819-4703-9774-1323bfb57418 with Priority: HIGHEST for action port [ 1031.595943] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.596093] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.596544] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.596544] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.596902] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-5daf8090-4819-4703-9774-1323bfb57418 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.597022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5daf8090-4819-4703-9774-1323bfb57418" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.597086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5daf8090-4819-4703-9774-1323bfb57418" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.597293] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5daf8090-4819-4703-9774-1323bfb57418" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.597374] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5daf8090-4819-4703-9774-1323bfb57418',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.102257] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5daf8090-4819-4703-9774-1323bfb57418 with status ACTIVE [ 1032.103196] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.103365] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.103508] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.103799] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.103957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.104297] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.104690] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.104690] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.104826] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.104951] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.105247] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.105352] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.105413] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.105729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.105729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.105729] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5daf8090-4819-4703-9774-1323bfb57418 is going to be updated. [ 1032.147396] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.147396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.147396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.147396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.147396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.148609] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5daf8090-4819-4703-9774-1323bfb57418" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.266874] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: SUCCESS [ 1032.267103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.267282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.267508] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.267700] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.267816] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.267874] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.268051] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.268127] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.268211] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.268311] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.269439] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.270204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.270204] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.270204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.270204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.270204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.270515] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.270515] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.465209] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 1032.465438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.543809] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-595 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.543809] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-595" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.543809] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-595" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.543809] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-595" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.543809] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.543809] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.543809] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.544369] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.544369] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.544369] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1032.544369] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1032.544520] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1032.544520] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1032.544591] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1032.544691] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1032.544810] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1032.569237] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1032.569550] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1032.569738] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1032.569874] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-595" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.570203] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-b654d6dc-b6b4-4db0-8f61-efac9ee47d6d taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.571430] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-b654d6dc-b6b4-4db0-8f61-efac9ee47d6d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.571430] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-b654d6dc-b6b4-4db0-8f61-efac9ee47d6d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.571430] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-b654d6dc-b6b4-4db0-8f61-efac9ee47d6d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.571430] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b654d6dc-b6b4-4db0-8f61-efac9ee47d6d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.773899] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.773899] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.773899] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.077031] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.077031] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.077031] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.077031] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.077031] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.077031] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port b654d6dc-b6b4-4db0-8f61-efac9ee47d6d not found, creating... [ 1033.077031] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.077031] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.077031] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.077031] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.077031] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.078255] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.080685] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.080685] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.080685] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.080685] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.080685] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: b654d6dc-b6b4-4db0-8f61-efac9ee47d6d is going to be created. [ 1033.101780] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.101780] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.101780] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.101780] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.101780] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.101780] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-b654d6dc-b6b4-4db0-8f61-efac9ee47d6d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.276678] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.549080] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: SUCCESS [ 1033.549413] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.549464] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.549668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.549849] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.549962] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.550037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.550174] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.550264] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.550342] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.550429] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.778224] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.778403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.778403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.779503] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.779503] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.779503] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b is going to be updated. [ 1033.808239] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.808403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.808469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.808675] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.808818] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.818806] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: IN_PROGRESS for 2s [ 1033.828696] env[66834]: INFO networking_nsxv3.common.synchronization [req-ce0092fe-2008-48cf-88de-155465e21250 req-8198af66-baf6-4c5f-b45b-960180d14244 service nova] Enqueued Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_rules [ 1033.828696] env[66834]: INFO networking_nsxv3.common.synchronization [req-ce0092fe-2008-48cf-88de-155465e21250 req-8198af66-baf6-4c5f-b45b-960180d14244 service nova] Enqueued Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1033.828696] env[66834]: INFO networking_nsxv3.common.synchronization [req-ce0092fe-2008-48cf-88de-155465e21250 req-8198af66-baf6-4c5f-b45b-960180d14244 service nova] Enqueued Resource ID: b654d6dc-b6b4-4db0-8f61-efac9ee47d6d with Priority: HIGHEST for action port [ 1033.830171] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_rules [ 1033.830171] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1033.830171] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b654d6dc-b6b4-4db0-8f61-efac9ee47d6d with Priority: HIGHEST for action port [ 1033.830171] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.830171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.831230] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.831530] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.831666] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-b654d6dc-b6b4-4db0-8f61-efac9ee47d6d taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.831666] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b654d6dc-b6b4-4db0-8f61-efac9ee47d6d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.831778] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b654d6dc-b6b4-4db0-8f61-efac9ee47d6d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.831960] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b654d6dc-b6b4-4db0-8f61-efac9ee47d6d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.832043] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b654d6dc-b6b4-4db0-8f61-efac9ee47d6d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.052929] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.053132] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.053217] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.053397] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.053595] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.053847] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.053847] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.053847] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.054030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.054030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.054201] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.054294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.054352] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.054491] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.054623] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.054709] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.054763] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.054891] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.054963] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.055054] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.055144] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.346887] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b654d6dc-b6b4-4db0-8f61-efac9ee47d6d with status ACTIVE [ 1034.346887] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.347150] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.347150] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.347222] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.349832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.349832] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.349832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.349832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.349832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.349832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.349832] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.349832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.349832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.349832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.349832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.349832] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b654d6dc-b6b4-4db0-8f61-efac9ee47d6d is going to be updated. [ 1034.371991] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.374030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.374030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.374030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.374030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.374030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b654d6dc-b6b4-4db0-8f61-efac9ee47d6d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.557154] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a15c14c6-0aee-4e9d-b481-2661c510f44a: rpc.has_security_group_logging(os_id): False [ 1034.578604] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.578795] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.578795] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.579044] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.579153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.579358] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.579477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.579531] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.579680] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.579764] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.579931] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.580059] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.580108] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.580300] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.580300] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.580490] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.580588] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.580652] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.580909] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.580971] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.584162] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be created. [ 1034.735769] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.735929] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.736008] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.736248] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.736424] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.757714] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: IN_PROGRESS for 2s [ 1035.830114] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: SUCCESS [ 1035.830503] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.830601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.830825] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.831059] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.831187] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.831260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.831429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.831532] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.831619] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.831792] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.831868] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.831950] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.832098] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.832246] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.832342] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.832403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.832542] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.832615] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.832695] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.832782] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.833729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.833896] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.834057] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.834163] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.834238] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.834378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.834455] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.834542] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.337466] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b: rpc.has_security_group_logging(os_id): False [ 1036.338681] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.359246] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.359438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.359438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.359654] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.359743] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.359928] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.360038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.360103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.360266] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.360325] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.360506] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.360629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.360692] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.360833] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.360910] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.361257] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.361384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.361449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.361605] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.361681] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.361772] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b is going to be created. [ 1036.419595] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.419748] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.419819] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.420040] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.420221] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.433177] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: IN_PROGRESS for 2s [ 1036.775404] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: SUCCESS [ 1036.775724] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.842212] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.344989] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.345322] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.345322] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.345456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.345893] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.345893] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b is going to be updated. [ 1037.377194] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.377348] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.377420] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.377664] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.377801] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.386935] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: IN_PROGRESS for 2s [ 1037.405043] env[66834]: INFO networking_nsxv3.common.synchronization [req-190ee78a-a612-4da8-9931-6904c5dc91f2 req-5044aa91-4d59-41ca-b203-c307887c6069 tempest-AttachInterfacesTestJSON-77868371 tempest-AttachInterfacesTestJSON-77868371-project-member] Enqueued Resource ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 with Priority: HIGHEST for action security_group_members [ 1037.406098] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 with Priority: HIGHEST for action security_group_members [ 1037.406098] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.406281] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.406323] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.406625] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.406818] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.406949] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.407099] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.407243] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.409079] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.409079] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac8e3a64-d540-43bb-a864-6d42bf3a44c4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.587651] env[66834]: INFO networking_nsxv3.common.synchronization [req-a4feb8a2-2182-49f1-aa4e-c8e648cca57b req-106b1bec-dcb6-45c7-a354-7a5c0cbe18df tempest-ServerActionsTestJSON-2105447671 tempest-ServerActionsTestJSON-2105447671-project-member] Enqueued Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_members [ 1037.588549] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_members [ 1037.589303] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b33fa48-b9ca-426c-b890-67d4639035e2 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.589433] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.589475] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.590329] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.590329] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.590492] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.590492] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.591108] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.591108] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.591108] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.833615] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-106 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.833851] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.833974] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.834272] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.834600] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.834912] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.835354] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.835747] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.837980] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.837980] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1037.837980] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1037.837980] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1037.837980] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1037.837980] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1037.837980] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1037.837980] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1037.857879] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1037.857879] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1037.858254] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1037.858254] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.858682] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-aac6a054-e247-462b-b1ff-10cb489c563c taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.858925] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-aac6a054-e247-462b-b1ff-10cb489c563c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.859150] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-aac6a054-e247-462b-b1ff-10cb489c563c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.859571] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-aac6a054-e247-462b-b1ff-10cb489c563c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.859764] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aac6a054-e247-462b-b1ff-10cb489c563c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.912369] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.912555] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.912555] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.912840] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.912840] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.913056] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.913177] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.913246] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.913414] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.913498] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.913582] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 already deleted. [ 1037.913680] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.095810] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.095986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.096057] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.096307] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.118069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.118372] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.118507] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.118576] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.118769] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.118876] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.119053] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 is going to be updated. [ 1038.150665] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.150880] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.151205] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.151279] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.151430] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.163990] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 in Status: IN_PROGRESS for 2s [ 1038.362389] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.362736] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.363427] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.363427] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.363611] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.363839] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port aac6a054-e247-462b-b1ff-10cb489c563c not found, creating... [ 1038.364299] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.364666] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.365757] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.367445] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.367445] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.367781] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.367915] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.368042] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.368307] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.368444] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.368588] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: aac6a054-e247-462b-b1ff-10cb489c563c is going to be created. [ 1038.393458] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.394512] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.394512] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.394512] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.394512] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.394971] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-aac6a054-e247-462b-b1ff-10cb489c563c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.460660] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: SUCCESS [ 1038.460836] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.461034] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.461306] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.461401] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.965025] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.965025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.110022] env[66834]: INFO networking_nsxv3.common.synchronization [req-190ee78a-a612-4da8-9931-6904c5dc91f2 req-91c67c2e-ff8e-4924-bdc4-d0a17aaebe31 service nova] Enqueued Resource ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 with Priority: HIGHEST for action security_group_rules [ 1039.110022] env[66834]: INFO networking_nsxv3.common.synchronization [req-190ee78a-a612-4da8-9931-6904c5dc91f2 req-91c67c2e-ff8e-4924-bdc4-d0a17aaebe31 service nova] Enqueued Resource ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 with Priority: HIGHEST for action security_group_members [ 1039.110022] env[66834]: INFO networking_nsxv3.common.synchronization [req-190ee78a-a612-4da8-9931-6904c5dc91f2 req-91c67c2e-ff8e-4924-bdc4-d0a17aaebe31 service nova] Enqueued Resource ID: aac6a054-e247-462b-b1ff-10cb489c563c with Priority: HIGHEST for action port [ 1039.110451] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 with Priority: HIGHEST for action security_group_rules [ 1039.110619] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 with Priority: HIGHEST for action security_group_members [ 1039.110743] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aac6a054-e247-462b-b1ff-10cb489c563c with Priority: HIGHEST for action port [ 1039.111133] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac8e3a64-d540-43bb-a864-6d42bf3a44c4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.111275] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.111358] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.111623] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.111733] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac8e3a64-d540-43bb-a864-6d42bf3a44c4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.113394] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.113394] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.113591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.113591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.113747] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.113839] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.114565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.114565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.114565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.114565] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac8e3a64-d540-43bb-a864-6d42bf3a44c4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.114974] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-aac6a054-e247-462b-b1ff-10cb489c563c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.115101] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aac6a054-e247-462b-b1ff-10cb489c563c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.115164] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aac6a054-e247-462b-b1ff-10cb489c563c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.115419] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aac6a054-e247-462b-b1ff-10cb489c563c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.115419] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aac6a054-e247-462b-b1ff-10cb489c563c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.397756] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: SUCCESS [ 1039.397970] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.398663] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.398892] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.399117] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.399469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.399469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.399607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.399607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.399708] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.399745] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.616647] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.616795] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.617020] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac8e3a64-d540-43bb-a864-6d42bf3a44c4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.621282] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aac6a054-e247-462b-b1ff-10cb489c563c with status ACTIVE [ 1039.621535] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.621669] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.621752] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.621965] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.622203] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.622412] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.622527] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.622822] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.622822] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.623078] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.623078] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.623215] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.623251] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.623375] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.623518] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.623592] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aac6a054-e247-462b-b1ff-10cb489c563c is going to be updated. [ 1039.645794] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.646057] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.646057] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.646274] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.646383] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.646545] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aac6a054-e247-462b-b1ff-10cb489c563c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.901942] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.902124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.902225] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.902394] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.902563] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.902662] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.902726] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.902870] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.902954] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.903051] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.903233] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.903329] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.903441] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.903556] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.903662] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.903750] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.903810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.903945] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.904047] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.904135] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.904227] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.119739] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac8e3a64-d540-43bb-a864-6d42bf3a44c4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.179594] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 in Status: SUCCESS [ 1040.179790] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 deletion is rescheduled due to dependency. [ 1040.179908] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.406072] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b: rpc.has_security_group_logging(os_id): False [ 1040.423905] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.424085] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.424141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.424379] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.424471] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.424662] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.424764] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.424825] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.424972] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.425060] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.425251] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.425347] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.425410] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.425547] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.425619] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.425801] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.425895] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.425957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.426118] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.426194] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.426277] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b is going to be updated. [ 1040.490094] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.490360] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.490429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.490594] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.490737] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.507261] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: IN_PROGRESS for 2s [ 1040.623142] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.623470] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.623470] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.623759] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.623837] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.623938] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 is going to be created. [ 1040.651041] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.651347] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.651347] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.651524] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.651683] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.665992] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 in Status: UNINITIALIZED for 2s [ 1040.847061] env[66834]: INFO networking_nsxv3.common.synchronization [req-6b5d1bcd-29f5-4f1a-81cb-48b34264ef01 req-90f95030-a480-403c-9fa9-92f864839007 tempest-ServerPasswordTestJSON-225396858 tempest-ServerPasswordTestJSON-225396858-project-member] Enqueued Resource ID: 44bd23af-d078-428a-9579-9dc775303088 with Priority: HIGHEST for action security_group_members [ 1040.848730] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44bd23af-d078-428a-9579-9dc775303088 with Priority: HIGHEST for action security_group_members [ 1040.848786] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-44bd23af-d078-428a-9579-9dc775303088 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.850036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.850036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.850036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.850036] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.850036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.850036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.850036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.850036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.850397] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44bd23af-d078-428a-9579-9dc775303088',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.245845] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-564 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.246317] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-564" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.246317] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-564" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.246491] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-564" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.246749] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.246903] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.247023] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.247250] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.247392] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.247613] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.247855] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1041.247975] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1041.248094] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1041.248202] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.248308] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1041.248436] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.270266] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.270452] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1041.270611] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.270790] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-564" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.271288] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-929e01b7-7a79-4105-95bf-7aafa8b41763 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.271426] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-929e01b7-7a79-4105-95bf-7aafa8b41763" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.271426] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-929e01b7-7a79-4105-95bf-7aafa8b41763" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.271751] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-929e01b7-7a79-4105-95bf-7aafa8b41763" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.271896] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('929e01b7-7a79-4105-95bf-7aafa8b41763',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.353469] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.353701] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.353934] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.354206] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.354332] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.354548] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.354682] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.354766] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.354926] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.355014] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.355155] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44bd23af-d078-428a-9579-9dc775303088 already deleted. [ 1041.355226] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.774933] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.775209] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.775298] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.775576] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.775724] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.775878] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 929e01b7-7a79-4105-95bf-7aafa8b41763 not found, creating... [ 1041.776150] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.776314] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.776419] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.776636] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.776768] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.777100] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.777213] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.777309] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.777523] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.777652] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.777785] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 929e01b7-7a79-4105-95bf-7aafa8b41763 is going to be created. [ 1041.799698] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.799912] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.800025] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.800287] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.800513] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.800743] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-929e01b7-7a79-4105-95bf-7aafa8b41763" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.530054] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: SUCCESS [ 1042.530418] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.530609] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.530907] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.531058] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.590011] env[66834]: INFO networking_nsxv3.common.synchronization [req-6b5d1bcd-29f5-4f1a-81cb-48b34264ef01 req-fd7326cf-723d-4207-84f6-8b719a6ef99c service nova] Enqueued Resource ID: 44bd23af-d078-428a-9579-9dc775303088 with Priority: HIGHEST for action security_group_rules [ 1042.590011] env[66834]: INFO networking_nsxv3.common.synchronization [req-6b5d1bcd-29f5-4f1a-81cb-48b34264ef01 req-fd7326cf-723d-4207-84f6-8b719a6ef99c service nova] Enqueued Resource ID: 44bd23af-d078-428a-9579-9dc775303088 with Priority: HIGHEST for action security_group_members [ 1042.590011] env[66834]: INFO networking_nsxv3.common.synchronization [req-6b5d1bcd-29f5-4f1a-81cb-48b34264ef01 req-fd7326cf-723d-4207-84f6-8b719a6ef99c service nova] Enqueued Resource ID: 929e01b7-7a79-4105-95bf-7aafa8b41763 with Priority: HIGHEST for action port [ 1042.590011] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44bd23af-d078-428a-9579-9dc775303088 with Priority: HIGHEST for action security_group_rules [ 1042.590011] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44bd23af-d078-428a-9579-9dc775303088 with Priority: HIGHEST for action security_group_members [ 1042.590011] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 929e01b7-7a79-4105-95bf-7aafa8b41763 with Priority: HIGHEST for action port [ 1042.590011] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44bd23af-d078-428a-9579-9dc775303088 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.590011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.590011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.590011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.590011] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44bd23af-d078-428a-9579-9dc775303088',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.591051] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-44bd23af-d078-428a-9579-9dc775303088 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.591051] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.591051] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.591639] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.591774] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.591980] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.592078] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.592289] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.592379] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.592464] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44bd23af-d078-428a-9579-9dc775303088',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.594198] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-929e01b7-7a79-4105-95bf-7aafa8b41763 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.594348] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-929e01b7-7a79-4105-95bf-7aafa8b41763" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.594436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-929e01b7-7a79-4105-95bf-7aafa8b41763" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.594505] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-929e01b7-7a79-4105-95bf-7aafa8b41763" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.595019] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('929e01b7-7a79-4105-95bf-7aafa8b41763',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.676225] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 in Status: SUCCESS [ 1042.676428] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.676591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.676807] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.676996] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.677130] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.677196] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.677349] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.677428] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.677513] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.677602] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac8e3a64-d540-43bb-a864-6d42bf3a44c4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.034334] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.034334] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.036148] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.036148] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.036148] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.036148] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.036148] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.036148] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.036148] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.036148] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.036148] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.095230] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44bd23af-d078-428a-9579-9dc775303088',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.096352] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 929e01b7-7a79-4105-95bf-7aafa8b41763 with status ACTIVE [ 1043.096807] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.096807] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.097065] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.097158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.097212] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.097408] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.097526] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.097574] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.097740] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.097822] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.098042] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.098184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.098184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.098791] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.098791] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.098791] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 929e01b7-7a79-4105-95bf-7aafa8b41763 is going to be updated. [ 1043.100247] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-44bd23af-d078-428a-9579-9dc775303088 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.100247] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.124851] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.124851] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.126048] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.126048] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.126048] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.126048] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-929e01b7-7a79-4105-95bf-7aafa8b41763" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.179643] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac8e3a64-d540-43bb-a864-6d42bf3a44c4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.389099] env[66834]: INFO networking_nsxv3.common.synchronization [req-73ca2ee6-afd5-4c15-8e63-ca9d68fd5272 req-e0bf6de5-a281-4c73-8707-3a4dd89a4e38 tempest-ServerDiskConfigTestJSON-362503924 tempest-ServerDiskConfigTestJSON-362503924-project-member] Enqueued Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 1043.389721] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 1043.390104] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.390356] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.390356] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.390644] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.391417] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.391417] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.391417] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.391417] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.391633] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.391965] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.538970] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.539498] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.539498] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.539498] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.539683] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.539751] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.539751] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.540029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.540029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.540171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.540229] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.540362] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.540362] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.540488] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.540624] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.540716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.540772] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.540903] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.540976] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.541493] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.541493] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.602665] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44bd23af-d078-428a-9579-9dc775303088',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.684990] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac8e3a64-d540-43bb-a864-6d42bf3a44c4: rpc.has_security_group_logging(os_id): False [ 1043.709463] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.709650] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.709731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.709937] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.710033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.710297] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.710412] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.710480] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.710678] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.710775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.710873] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 is going to be created. [ 1043.796464] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-98 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.796665] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-98" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.796795] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-98" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.797098] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-98" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.797407] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.797575] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.797698] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.797952] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.798107] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.798309] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1043.798418] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1043.798518] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1043.798624] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1043.798778] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1043.799021] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1043.799511] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1043.844175] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1043.844175] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.045 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1043.844175] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1043.844385] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-98" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.844637] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-b8f3bc00-9833-42fa-9bda-f02467c8adcb taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.844810] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-b8f3bc00-9833-42fa-9bda-f02467c8adcb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.844925] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-b8f3bc00-9833-42fa-9bda-f02467c8adcb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.845294] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-b8f3bc00-9833-42fa-9bda-f02467c8adcb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.845419] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8f3bc00-9833-42fa-9bda-f02467c8adcb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.848204] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.848446] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.848446] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.848658] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.848913] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.867513] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 in Status: IN_PROGRESS for 2s [ 1043.894756] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.895085] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.895248] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.895638] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.895787] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.896131] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.896250] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.896323] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.896496] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.896576] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.896698] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7963c125-23b5-45fd-8158-f6470d12949e is going to be updated. [ 1043.941863] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.941863] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.941863] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.942323] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.942323] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.953032] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: IN_PROGRESS for 2s [ 1044.043706] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b: rpc.has_security_group_logging(os_id): False [ 1044.069837] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.070077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.070077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.070322] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.070425] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.070647] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.070755] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.070801] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.070975] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.071057] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.071546] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.071546] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.071546] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.071821] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.071821] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.071916] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.071978] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.072029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.072176] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.072247] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.072329] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b is going to be updated. [ 1044.107617] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.107905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.107905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.108058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.108153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.108247] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44bd23af-d078-428a-9579-9dc775303088 is going to be created. [ 1044.150538] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.150864] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.150864] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.151040] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.151239] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.153523] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.153691] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.153779] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.153991] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.154200] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.167784] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44bd23af-d078-428a-9579-9dc775303088 in Status: UNINITIALIZED for 2s [ 1044.171584] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: IN_PROGRESS for 2s [ 1044.353421] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.353677] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.353871] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.354215] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.354407] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.354615] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port b8f3bc00-9833-42fa-9bda-f02467c8adcb not found, creating... [ 1044.354906] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.355166] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.355247] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.355553] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.355646] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.355944] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.356114] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.356229] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.356445] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.356577] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.356714] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: b8f3bc00-9833-42fa-9bda-f02467c8adcb is going to be created. [ 1044.381848] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.382174] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.382264] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.382801] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.382801] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.383040] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-b8f3bc00-9833-42fa-9bda-f02467c8adcb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.109640] env[66834]: INFO networking_nsxv3.common.synchronization [req-73ca2ee6-afd5-4c15-8e63-ca9d68fd5272 req-c87d53ff-da1b-47f3-9e94-09be076caa99 service nova] Enqueued Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_rules [ 1045.109640] env[66834]: INFO networking_nsxv3.common.synchronization [req-73ca2ee6-afd5-4c15-8e63-ca9d68fd5272 req-c87d53ff-da1b-47f3-9e94-09be076caa99 service nova] Enqueued Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 1045.109640] env[66834]: INFO networking_nsxv3.common.synchronization [req-73ca2ee6-afd5-4c15-8e63-ca9d68fd5272 req-c87d53ff-da1b-47f3-9e94-09be076caa99 service nova] Enqueued Resource ID: b8f3bc00-9833-42fa-9bda-f02467c8adcb with Priority: HIGHEST for action port [ 1045.110410] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_rules [ 1045.110410] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 1045.110410] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f3bc00-9833-42fa-9bda-f02467c8adcb with Priority: HIGHEST for action port [ 1045.110607] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.110607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.110607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.110810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.110979] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.112071] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.112071] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.112190] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8f3bc00-9833-42fa-9bda-f02467c8adcb taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.112294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8f3bc00-9833-42fa-9bda-f02467c8adcb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.112461] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8f3bc00-9833-42fa-9bda-f02467c8adcb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.112792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8f3bc00-9833-42fa-9bda-f02467c8adcb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.112856] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8f3bc00-9833-42fa-9bda-f02467c8adcb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.566989] env[66834]: INFO networking_nsxv3.common.synchronization [req-e5fcf5b6-ef19-4815-9b9c-afcb9af7ba65 req-21f6a107-e6f5-4e06-9fec-6f8e9eaff461 tempest-ServersTestMultiNic-565362409 tempest-ServersTestMultiNic-565362409-project-member] Enqueued Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1045.567626] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1045.567978] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.570484] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.570484] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.570626] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.570795] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.571019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.571128] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.571708] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.571708] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.571708] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.615528] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.615723] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.615845] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8f3bc00-9833-42fa-9bda-f02467c8adcb with status ACTIVE [ 1045.617545] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.617545] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.617545] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.617545] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.617545] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.617893] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.617893] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.617893] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.618041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.618041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.618476] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.618476] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.618476] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.618657] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.618657] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.618657] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8f3bc00-9833-42fa-9bda-f02467c8adcb is going to be updated. [ 1045.643804] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.643978] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.644069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.644384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.644590] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.644722] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8f3bc00-9833-42fa-9bda-f02467c8adcb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.774207] env[66834]: INFO networking_nsxv3.common.synchronization [req-e5fcf5b6-ef19-4815-9b9c-afcb9af7ba65 req-02e4a91a-a380-48b7-a852-b555da1cecf6 tempest-ServersTestMultiNic-565362409 tempest-ServersTestMultiNic-565362409-project-member] Enqueued Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1045.774207] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1045.774207] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.774207] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.883318] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 in Status: SUCCESS [ 1045.883636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.963457] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: SUCCESS [ 1045.964194] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7963c125-23b5-45fd-8158-f6470d12949e deletion is rescheduled due to dependency. [ 1045.964194] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.964194] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.964442] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.964653] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.964776] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.964840] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.965009] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.965097] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.965214] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.982929] env[66834]: INFO networking_nsxv3.common.synchronization [req-e5fcf5b6-ef19-4815-9b9c-afcb9af7ba65 req-2b848bb9-65ad-487e-84ca-888f66ee9dd9 tempest-ServersTestMultiNic-565362409 tempest-ServersTestMultiNic-565362409-project-member] Enqueued Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1045.983448] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1045.983787] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.983913] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.074283] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.181345] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44bd23af-d078-428a-9579-9dc775303088 in Status: SUCCESS [ 1046.181674] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.181741] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.182363] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.182363] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.182363] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.182363] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.182639] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.182639] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.182639] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.182752] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44bd23af-d078-428a-9579-9dc775303088',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.189595] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: SUCCESS [ 1046.189813] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.467082] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.579441] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.686996] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-44bd23af-d078-428a-9579-9dc775303088 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.687116] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.687209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.687350] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.687515] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.687617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.687679] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.687827] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.687913] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.687997] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.688156] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-44bd23af-d078-428a-9579-9dc775303088 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.688248] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.688308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.688446] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.688686] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.688686] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.688803] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.688843] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.688912] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.688990] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.689101] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44bd23af-d078-428a-9579-9dc775303088',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.960305] env[66834]: INFO networking_nsxv3.common.synchronization [req-e2668059-6d99-4ca7-8dac-06b0d451dfc5 req-1f68a791-5d28-4f84-8d16-cf31de184b97 tempest-DeleteServersTestJSON-1250802255 tempest-DeleteServersTestJSON-1250802255-project-member] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 1046.961175] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 1046.961369] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.961488] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.961556] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.961759] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.961904] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.962010] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.962304] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.962866] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.963029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.963276] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.968847] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.081843] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.082052] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.082136] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.082417] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.082532] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.082632] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b is going to be updated. [ 1047.111117] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.111368] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.111368] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.111554] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.111689] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.123785] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: IN_PROGRESS for 2s [ 1047.191687] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44bd23af-d078-428a-9579-9dc775303088: rpc.has_security_group_logging(os_id): False [ 1047.211487] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.211487] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.211487] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.211721] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.211721] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.211925] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.212035] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.212084] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.212327] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.212327] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.212469] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.212543] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.212680] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.212730] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.212825] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.213218] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.213218] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.213218] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.213423] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.213423] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.213423] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44bd23af-d078-428a-9579-9dc775303088 is going to be created. [ 1047.287509] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.287509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.287509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.287509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.287509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.299163] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44bd23af-d078-428a-9579-9dc775303088 in Status: IN_PROGRESS for 2s [ 1047.465141] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.465386] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.465386] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.466478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.466478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.466478] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.466478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.466478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.466478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.466478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.466478] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be updated. [ 1047.471177] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.471490] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.472728] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.472728] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.472728] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.472728] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7963c125-23b5-45fd-8158-f6470d12949e is going to be updated. [ 1047.500105] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.500496] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.500668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.502307] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.502307] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.504067] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.506728] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.507460] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.508423] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.508423] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.519535] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: IN_PROGRESS for 2s [ 1047.520248] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: IN_PROGRESS for 2s [ 1049.136163] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: SUCCESS [ 1049.136449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.136673] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.136963] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.137230] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.137387] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.137477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.137680] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.137786] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.137911] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.319840] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44bd23af-d078-428a-9579-9dc775303088 in Status: SUCCESS [ 1049.320041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.532150] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: SUCCESS [ 1049.532338] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a deletion is rescheduled due to dependency. [ 1049.532481] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.533240] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: SUCCESS [ 1049.533410] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.533557] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.533813] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.534016] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.534138] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.534202] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.534410] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.534513] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.534604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.534694] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.640266] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.640421] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.640512] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.640819] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.640940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.641163] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.641338] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.641420] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.641561] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.641637] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.641725] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b is going to be updated. [ 1049.673210] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.673210] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.673444] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.673444] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.673650] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.683924] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: IN_PROGRESS for 2s [ 1050.018703] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-615 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.018924] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-615" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.019063] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-615" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.019337] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-615" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.019588] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.019742] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.019858] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.020091] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.020238] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.020440] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1050.020554] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1050.020661] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1050.020765] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1050.020871] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1050.020974] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1050.021119] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1050.036814] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.036959] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.037070] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.037255] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.037427] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.037522] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.037580] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.037733] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.037821] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.037946] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.038079] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.038180] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.038235] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.038364] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.038499] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.038581] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.038641] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.038777] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.038849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.038928] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.039034] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.041666] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1050.041822] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1050.041957] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1050.042133] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-615" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.042525] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.042686] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.042820] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.043020] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.043150] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.543382] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7963c125-23b5-45fd-8158-f6470d12949e: rpc.has_security_group_logging(os_id): False [ 1050.546641] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.546915] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.547074] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.547369] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.547521] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.547817] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.547974] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.548105] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.548321] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.548458] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.548732] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.548884] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.548998] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.549273] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.549421] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.549561] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3 is going to be updated. [ 1050.567020] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.567020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.567020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.567020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.567020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.567020] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.567020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.567020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.567448] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.567448] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.567448] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.567599] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.567599] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.567802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.567802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.567973] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.568161] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.568268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.568399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.568523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.569216] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7963c125-23b5-45fd-8158-f6470d12949e is going to be updated. [ 1050.575195] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.575443] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.575532] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.575792] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.575983] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.576216] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.659928] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.660163] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.660163] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.661334] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.661334] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.691659] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: IN_PROGRESS for 2s [ 1051.317052] env[66834]: INFO networking_nsxv3.common.synchronization [req-e26a5e0c-dee4-409a-abec-d80067cedc99 req-2ad7f291-2703-4b2d-9a8f-2df79c618fa3 service nova] Enqueued Resource ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c with Priority: HIGHEST for action security_group_rules [ 1051.317052] env[66834]: INFO networking_nsxv3.common.synchronization [req-e26a5e0c-dee4-409a-abec-d80067cedc99 req-2ad7f291-2703-4b2d-9a8f-2df79c618fa3 service nova] Enqueued Resource ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c with Priority: HIGHEST for action security_group_members [ 1051.317052] env[66834]: INFO networking_nsxv3.common.synchronization [req-e26a5e0c-dee4-409a-abec-d80067cedc99 req-2ad7f291-2703-4b2d-9a8f-2df79c618fa3 service nova] Enqueued Resource ID: a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3 with Priority: HIGHEST for action port [ 1051.317654] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c with Priority: HIGHEST for action security_group_rules [ 1051.317887] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c with Priority: HIGHEST for action security_group_members [ 1051.317887] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3 with Priority: HIGHEST for action port [ 1051.318188] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.318303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.318369] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.318566] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.318648] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.319545] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.319665] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.319716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.320442] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.320442] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.320442] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.320442] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.320442] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.320442] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.320771] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.323396] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.323396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.323396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.323396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.323396] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.694147] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: SUCCESS [ 1051.694477] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b deletion is rescheduled due to dependency. [ 1051.694477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.694681] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.694947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.695205] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.695368] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.695465] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.695676] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.695836] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.695921] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.823577] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.824705] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.824889] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.825177] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3 with status ACTIVE [ 1051.825330] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.825440] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.825500] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.825701] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.825831] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.825957] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.826065] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.826126] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.826274] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.826419] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.826597] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.826692] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.826753] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.826891] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.826963] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.827056] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3 is going to be updated. [ 1051.847818] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.848145] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.848145] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.848259] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.848426] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.848622] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7aa2be5-210a-42d8-8f02-ee0bbc0b94d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.198614] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.198614] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.199111] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.199111] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.199111] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.199303] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.199508] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.199601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.200185] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.200185] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.200185] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b is going to be updated. [ 1052.240020] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.240270] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.240456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.240738] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.240934] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.252462] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: IN_PROGRESS for 2s [ 1052.326055] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.707020] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: SUCCESS [ 1052.707020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.829082] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.829330] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.829406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.829632] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.829748] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.829888] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c is going to be updated. [ 1052.867212] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.868324] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.868324] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.868324] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.868324] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.884492] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c in Status: IN_PROGRESS for 2s [ 1054.264133] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: SUCCESS [ 1054.264539] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b deletion is rescheduled due to dependency. [ 1054.264539] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.898445] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c in Status: SUCCESS [ 1054.898674] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.898853] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.899097] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.899348] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.899482] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.899482] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.899721] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.899721] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.899817] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.899882] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.402464] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.402895] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.402895] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.403343] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.403444] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.403502] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.403574] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.403809] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.403853] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.403928] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.404396] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.404396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.404396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.404396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.404566] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.404846] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.404846] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.404846] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.404846] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.405039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.405039] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.576233] env[66834]: INFO networking_nsxv3.common.synchronization [req-27532b71-843f-4c8f-899e-6224581e275e req-1198b34b-f538-4354-8947-c839c3595969 tempest-ServerPasswordTestJSON-225396858 tempest-ServerPasswordTestJSON-225396858-project-member] Enqueued Resource ID: 44bd23af-d078-428a-9579-9dc775303088 with Priority: HIGHEST for action security_group_members [ 1055.577036] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44bd23af-d078-428a-9579-9dc775303088 with Priority: HIGHEST for action security_group_members [ 1055.577036] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-44bd23af-d078-428a-9579-9dc775303088 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.577246] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.577246] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.577440] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.577597] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.577689] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.577756] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.577890] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.577978] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.578081] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44bd23af-d078-428a-9579-9dc775303088',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.907860] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c: rpc.has_security_group_logging(os_id): False [ 1055.930916] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.931170] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.931229] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.931941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.965325] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.965325] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.965325] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.965325] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.965325] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.965325] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.965325] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.965325] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.966196] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.966196] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.966196] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.966196] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.966196] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.966196] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.966607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.966607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.966607] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c is going to be updated. [ 1056.053991] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.054444] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.054444] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.054654] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.054654] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.081967] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.082150] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.082207] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.082460] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.082590] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.082851] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.082967] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.083073] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.083255] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.083855] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.083855] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44bd23af-d078-428a-9579-9dc775303088 is going to be updated. [ 1056.087608] env[66834]: INFO networking_nsxv3.common.synchronization [req-54cf89b1-a26b-4bdb-96d5-e85f9582d11c req-dd56451c-3ac5-4faa-9a22-63b0a84f8d6e tempest-ImagesOneServerTestJSON-881436325 tempest-ImagesOneServerTestJSON-881436325-project-member] Enqueued Resource ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 with Priority: HIGHEST for action security_group_members [ 1056.088667] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c in Status: IN_PROGRESS for 2s [ 1056.089296] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 with Priority: HIGHEST for action security_group_members [ 1056.090188] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a374bf1-dcb9-4b0d-a02d-5649cc882880 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.090330] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.090441] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.090736] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.090895] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.091037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.091107] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.091292] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.091448] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.091559] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a374bf1-dcb9-4b0d-a02d-5649cc882880',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.156271] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.156271] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.156271] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.156618] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.157047] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.172289] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44bd23af-d078-428a-9579-9dc775303088 in Status: IN_PROGRESS for 2s [ 1056.594700] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.595055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.595055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.595367] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.595508] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.595813] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.595963] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.596068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.596330] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.596396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.596505] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 is going to be updated. [ 1056.628276] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.628276] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.628523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.628523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.628720] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.637939] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 in Status: IN_PROGRESS for 2s [ 1057.327692] env[66834]: INFO networking_nsxv3.common.synchronization [req-3535fd12-6f8e-4ff4-9230-12cbb5494ffd req-1523dacc-de5c-4e89-8d6c-c5c514499799 tempest-ServersTestJSON-861266990 tempest-ServersTestJSON-861266990-project-member] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1057.328552] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1057.329051] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.329250] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.329642] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.329869] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.332508] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.332744] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.332864] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.333206] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.333368] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.333541] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.714950] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-849 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.714950] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.714950] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.715949] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.715949] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.715949] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.715949] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.716389] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.716389] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.716577] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.717190] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1057.717190] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1057.717190] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1057.717443] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.717443] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1057.717652] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1057.743370] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1057.743546] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1057.743678] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1057.743893] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.744285] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-428808dd-da00-4042-9c95-e0b5882db809 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.744511] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-428808dd-da00-4042-9c95-e0b5882db809" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.744590] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-428808dd-da00-4042-9c95-e0b5882db809" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.744905] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-428808dd-da00-4042-9c95-e0b5882db809" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.745061] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('428808dd-da00-4042-9c95-e0b5882db809',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.837819] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.105269] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c in Status: SUCCESS [ 1058.105549] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.183682] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44bd23af-d078-428a-9579-9dc775303088 in Status: SUCCESS [ 1058.183939] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44bd23af-d078-428a-9579-9dc775303088 deletion is rescheduled due to dependency. [ 1058.184039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.247740] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.247981] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.248141] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.248465] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.248652] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.248829] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 428808dd-da00-4042-9c95-e0b5882db809 not found, creating... [ 1058.249108] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.249337] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.249472] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.249744] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.249896] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.250370] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.250543] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.250657] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.250883] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.251033] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.251218] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 428808dd-da00-4042-9c95-e0b5882db809 is going to be created. [ 1058.274905] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.275237] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.275319] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.275716] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.275982] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.276273] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-428808dd-da00-4042-9c95-e0b5882db809" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.340512] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.648994] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 in Status: IN_PROGRESS for 4s [ 1058.843764] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.844157] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.844157] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.844247] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.844353] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.844494] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be updated. [ 1058.881062] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.881062] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.881062] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.881062] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.881062] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.893608] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 1058.997252] env[66834]: INFO networking_nsxv3.common.synchronization [req-3535fd12-6f8e-4ff4-9230-12cbb5494ffd req-02450149-d57d-43f4-9dab-184c5f3ae2f4 service nova] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_rules [ 1058.997252] env[66834]: INFO networking_nsxv3.common.synchronization [req-3535fd12-6f8e-4ff4-9230-12cbb5494ffd req-02450149-d57d-43f4-9dab-184c5f3ae2f4 service nova] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1058.997252] env[66834]: INFO networking_nsxv3.common.synchronization [req-3535fd12-6f8e-4ff4-9230-12cbb5494ffd req-02450149-d57d-43f4-9dab-184c5f3ae2f4 service nova] Enqueued Resource ID: 428808dd-da00-4042-9c95-e0b5882db809 with Priority: HIGHEST for action port [ 1058.997252] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_rules [ 1058.997865] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1058.997865] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428808dd-da00-4042-9c95-e0b5882db809 with Priority: HIGHEST for action port [ 1058.998290] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.998396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.998494] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.998735] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.998834] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.000341] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.000444] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.002259] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-428808dd-da00-4042-9c95-e0b5882db809 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.002382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-428808dd-da00-4042-9c95-e0b5882db809" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.002444] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-428808dd-da00-4042-9c95-e0b5882db809" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.002646] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-428808dd-da00-4042-9c95-e0b5882db809" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.002722] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('428808dd-da00-4042-9c95-e0b5882db809',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.380951] env[66834]: INFO networking_nsxv3.common.synchronization [req-51d600b9-928d-46bf-9005-82dff6708aee req-bf2f692e-d15f-4bdc-8708-11a7c9133183 tempest-ServerDiskConfigTestJSON-362503924 tempest-ServerDiskConfigTestJSON-362503924-project-member] Enqueued Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 1059.381286] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7963c125-23b5-45fd-8158-f6470d12949e with Priority: HIGHEST for action security_group_members [ 1059.382036] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7963c125-23b5-45fd-8158-f6470d12949e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.382036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.382036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.382281] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.382281] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.382449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.382449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.382579] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.382981] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.382981] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7963c125-23b5-45fd-8158-f6470d12949e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.505234] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.505384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.505578] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 428808dd-da00-4042-9c95-e0b5882db809 with status ACTIVE [ 1059.505747] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.505863] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.505923] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.506145] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.506227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.506409] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.506510] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.506570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.506714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.506786] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.506961] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.507057] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.507115] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.507276] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.507321] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.507415] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 428808dd-da00-4042-9c95-e0b5882db809 is going to be updated. [ 1059.534160] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.534336] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.534389] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.534568] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.534714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.534870] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-428808dd-da00-4042-9c95-e0b5882db809" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.885809] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.886256] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.886256] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.886371] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.886473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.886755] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.886876] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.886943] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.887160] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.887283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.887372] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7963c125-23b5-45fd-8158-f6470d12949e is going to be updated. [ 1059.920392] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.920627] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.920627] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.920843] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.920991] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.935254] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: IN_PROGRESS for 2s [ 1060.664135] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 in Status: SUCCESS [ 1060.664135] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 deletion is rescheduled due to dependency. [ 1060.664135] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.905791] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 1060.906214] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.906214] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.906306] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.906514] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.906642] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.906788] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.906870] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.906953] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.907069] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.409933] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.568507] env[66834]: INFO networking_nsxv3.common.synchronization [req-91500a4c-f756-4d4a-a049-9347483ac32c req-0aefabdc-27b0-4a7e-8aab-e8433cec7296 tempest-AttachInterfacesTestJSON-77868371 tempest-AttachInterfacesTestJSON-77868371-project-member] Enqueued Resource ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 with Priority: HIGHEST for action security_group_members [ 1061.569014] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 with Priority: HIGHEST for action security_group_members [ 1061.569583] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.569765] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.569844] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.570177] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.571074] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.571213] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.571284] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.571560] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.571699] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.571802] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac8e3a64-d540-43bb-a864-6d42bf3a44c4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.910080] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-106 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.910431] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.910431] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.910657] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.911700] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.911700] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.911700] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.911700] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.911700] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.911980] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1061.911980] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1061.912086] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1061.912128] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1061.912353] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1061.912353] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1061.912469] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1061.914188] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.932370] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1061.932562] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1061.932715] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1061.932897] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.933230] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-227db61c-8548-41f9-9488-c698a6064d9c taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.933402] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-227db61c-8548-41f9-9488-c698a6064d9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.933616] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-227db61c-8548-41f9-9488-c698a6064d9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.933853] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-227db61c-8548-41f9-9488-c698a6064d9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.933993] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('227db61c-8548-41f9-9488-c698a6064d9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.944307] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7963c125-23b5-45fd-8158-f6470d12949e in Status: SUCCESS [ 1061.944489] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7963c125-23b5-45fd-8158-f6470d12949e deletion is rescheduled due to dependency. [ 1061.944601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7963c125-23b5-45fd-8158-f6470d12949e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.077392] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac8e3a64-d540-43bb-a864-6d42bf3a44c4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.416202] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.416399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.416483] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.416750] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.416868] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.416992] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be updated. [ 1062.436906] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.437169] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.437318] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.437678] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.437848] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.438014] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 227db61c-8548-41f9-9488-c698a6064d9c not found, creating... [ 1062.438291] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.438451] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.438570] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.438797] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.438931] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.439232] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.439402] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.439525] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.439708] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.439840] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.439978] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 227db61c-8548-41f9-9488-c698a6064d9c is going to be created. [ 1062.452069] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.452410] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.452647] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.452903] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.453837] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.467560] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 1062.472021] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.472021] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.472021] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.472021] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.472362] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.472710] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-227db61c-8548-41f9-9488-c698a6064d9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.581932] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac8e3a64-d540-43bb-a864-6d42bf3a44c4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.084821] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.085155] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.085155] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.085477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.085477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.085477] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 is going to be updated. [ 1063.120622] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.120822] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.120822] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.121183] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.121300] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.144637] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 in Status: IN_PROGRESS for 2s [ 1063.182332] env[66834]: INFO networking_nsxv3.common.synchronization [req-91500a4c-f756-4d4a-a049-9347483ac32c req-0f11ff7e-460a-420d-929d-22fa34180f73 service nova] Enqueued Resource ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 with Priority: HIGHEST for action security_group_rules [ 1063.182614] env[66834]: INFO networking_nsxv3.common.synchronization [req-91500a4c-f756-4d4a-a049-9347483ac32c req-0f11ff7e-460a-420d-929d-22fa34180f73 service nova] Enqueued Resource ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 with Priority: HIGHEST for action security_group_members [ 1063.182724] env[66834]: INFO networking_nsxv3.common.synchronization [req-91500a4c-f756-4d4a-a049-9347483ac32c req-0f11ff7e-460a-420d-929d-22fa34180f73 service nova] Enqueued Resource ID: 227db61c-8548-41f9-9488-c698a6064d9c with Priority: HIGHEST for action port [ 1063.183531] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 with Priority: HIGHEST for action security_group_rules [ 1063.183730] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 with Priority: HIGHEST for action security_group_members [ 1063.183923] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 227db61c-8548-41f9-9488-c698a6064d9c with Priority: HIGHEST for action port [ 1063.184531] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac8e3a64-d540-43bb-a864-6d42bf3a44c4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.184737] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.184849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.185161] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.185272] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac8e3a64-d540-43bb-a864-6d42bf3a44c4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.186328] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.186613] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.186874] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-227db61c-8548-41f9-9488-c698a6064d9c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.187086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-227db61c-8548-41f9-9488-c698a6064d9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.187149] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-227db61c-8548-41f9-9488-c698a6064d9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.187378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-227db61c-8548-41f9-9488-c698a6064d9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.187474] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('227db61c-8548-41f9-9488-c698a6064d9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.692220] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.692220] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.693729] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 227db61c-8548-41f9-9488-c698a6064d9c with status ACTIVE [ 1063.694066] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.694209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.694319] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.694622] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.694718] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.694994] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.695116] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.695181] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.695346] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.695427] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.695733] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.695892] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.695997] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.696130] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.696206] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.696294] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 227db61c-8548-41f9-9488-c698a6064d9c is going to be updated. [ 1063.735338] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.735601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.735601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.735757] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.736111] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.736111] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-227db61c-8548-41f9-9488-c698a6064d9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.482473] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 1064.482826] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.482826] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.483144] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.483347] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.483466] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.483532] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.483698] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.483787] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.483918] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.484038] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.952042] env[66834]: INFO networking_nsxv3.common.synchronization [req-e2bf5dc3-bf47-45bc-bb90-61076944d728 req-69b292e5-5313-465f-84b3-e1567c05be98 tempest-ServerActionsTestJSON-2105447671 tempest-ServerActionsTestJSON-2105447671-project-member] Enqueued Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_members [ 1064.953019] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_members [ 1064.953275] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b33fa48-b9ca-426c-b890-67d4639035e2 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.955935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.955935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.955935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.955935] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.955935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.955935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.955935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.955935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.955935] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.986735] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.988558] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.988558] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.988558] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.988558] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.988558] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.988558] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.988558] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.988558] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.988558] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.989048] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.989048] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.989140] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.989276] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.989472] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.989614] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.989857] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.990056] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.990170] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.990283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.990399] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.158078] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 in Status: SUCCESS [ 1065.158078] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.158078] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.158078] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.158078] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.158078] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.158078] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.158078] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.158078] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.158078] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac8e3a64-d540-43bb-a864-6d42bf3a44c4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.313941] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-591 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.314247] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-591" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.314408] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-591" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.314757] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-591" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.315142] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.315352] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.315510] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.315836] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.316040] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.316324] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1065.316471] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1065.316622] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1065.316750] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1065.316865] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1065.316973] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1065.317117] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1065.337996] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1065.338310] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1065.338472] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1065.338768] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-591" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.339191] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-c2630ad9-1c26-483a-8ebd-2305c92f519c taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.339419] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-c2630ad9-1c26-483a-8ebd-2305c92f519c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.339567] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-c2630ad9-1c26-483a-8ebd-2305c92f519c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.340037] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-c2630ad9-1c26-483a-8ebd-2305c92f519c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.340248] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2630ad9-1c26-483a-8ebd-2305c92f519c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.457141] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.457331] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.457405] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.457664] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.457768] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.458011] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.458144] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.458202] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.458369] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.458446] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.458533] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 is going to be updated. [ 1065.493775] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.494105] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.494105] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.494256] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.494400] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.495825] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c88662f-4694-4988-b716-56b85d22f3c9: rpc.has_security_group_logging(os_id): False [ 1065.507963] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 in Status: IN_PROGRESS for 2s [ 1065.516684] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.516684] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.516684] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.516684] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.516684] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.517101] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.517101] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.517101] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.517258] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.517301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.517488] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.517580] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.517632] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.517771] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.517893] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.518046] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.518141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.518198] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.518338] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.518411] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.518493] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be updated. [ 1065.588272] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.588481] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.588481] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.588661] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.588800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.605741] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 1065.659806] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac8e3a64-d540-43bb-a864-6d42bf3a44c4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.843088] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.843313] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.843525] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.843734] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.843881] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.844060] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port c2630ad9-1c26-483a-8ebd-2305c92f519c not found, creating... [ 1065.844312] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.844472] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.844675] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.844935] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.845796] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.846148] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.846306] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.846946] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.847205] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.847337] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.847484] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: c2630ad9-1c26-483a-8ebd-2305c92f519c is going to be created. [ 1065.867328] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.867590] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.867590] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.867857] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.868092] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.868314] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-c2630ad9-1c26-483a-8ebd-2305c92f519c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.162183] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac8e3a64-d540-43bb-a864-6d42bf3a44c4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.617312] env[66834]: INFO networking_nsxv3.common.synchronization [req-e2bf5dc3-bf47-45bc-bb90-61076944d728 req-bf825ebf-69cd-4516-96a4-d53bc06afd7e service nova] Enqueued Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_rules [ 1066.617609] env[66834]: INFO networking_nsxv3.common.synchronization [req-e2bf5dc3-bf47-45bc-bb90-61076944d728 req-bf825ebf-69cd-4516-96a4-d53bc06afd7e service nova] Enqueued Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_members [ 1066.617609] env[66834]: INFO networking_nsxv3.common.synchronization [req-e2bf5dc3-bf47-45bc-bb90-61076944d728 req-bf825ebf-69cd-4516-96a4-d53bc06afd7e service nova] Enqueued Resource ID: c2630ad9-1c26-483a-8ebd-2305c92f519c with Priority: HIGHEST for action port [ 1066.618216] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_rules [ 1066.618373] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_members [ 1066.618495] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2630ad9-1c26-483a-8ebd-2305c92f519c with Priority: HIGHEST for action port [ 1066.619381] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b33fa48-b9ca-426c-b890-67d4639035e2 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.619649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.619822] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.620174] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.620350] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.621602] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b33fa48-b9ca-426c-b890-67d4639035e2 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.621766] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.622097] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2630ad9-1c26-483a-8ebd-2305c92f519c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.622265] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2630ad9-1c26-483a-8ebd-2305c92f519c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.622362] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2630ad9-1c26-483a-8ebd-2305c92f519c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.622623] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2630ad9-1c26-483a-8ebd-2305c92f519c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.622755] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2630ad9-1c26-483a-8ebd-2305c92f519c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.666473] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.666785] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.666785] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.666913] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.666991] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.668558] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 is going to be updated. [ 1066.700791] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.701112] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.701112] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.701244] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.701334] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.712917] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 in Status: IN_PROGRESS for 2s [ 1067.125745] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b33fa48-b9ca-426c-b890-67d4639035e2 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.127082] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.127471] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2630ad9-1c26-483a-8ebd-2305c92f519c with status ACTIVE [ 1067.127471] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.127634] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.127690] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.127956] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.128107] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.128329] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.128476] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.128581] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.128778] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.128898] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.129356] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.129356] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.129562] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.129735] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.129855] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.129982] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2630ad9-1c26-483a-8ebd-2305c92f519c is going to be updated. [ 1067.154440] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.154876] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.154876] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.155274] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.155478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.155909] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2630ad9-1c26-483a-8ebd-2305c92f519c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.525475] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 in Status: SUCCESS [ 1067.525770] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 deletion is rescheduled due to dependency. [ 1067.525944] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.526145] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.526368] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.526559] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.526689] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.526767] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.526888] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.526980] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.527081] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.622030] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 1067.622523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.029945] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.534093] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.725549] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 in Status: SUCCESS [ 1068.726763] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.726763] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.726763] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.726763] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.726763] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.726763] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.726763] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.727241] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.727241] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.727241] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac8e3a64-d540-43bb-a864-6d42bf3a44c4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.037070] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.037325] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.037429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.037659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.037744] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.037840] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 is going to be updated. [ 1069.072734] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.072937] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.073371] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.073579] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.073749] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.086860] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 in Status: IN_PROGRESS for 2s [ 1069.230563] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac8e3a64-d540-43bb-a864-6d42bf3a44c4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.732961] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac8e3a64-d540-43bb-a864-6d42bf3a44c4: rpc.has_security_group_logging(os_id): False [ 1069.753069] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.753729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.753729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.753729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.753729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.753995] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.753995] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.753995] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.754370] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.754370] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.754370] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 is going to be updated. [ 1069.825869] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.826218] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.826218] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.826459] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.826459] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.847820] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 in Status: IN_PROGRESS for 2s [ 1070.951827] env[66834]: INFO networking_nsxv3.common.synchronization [req-42ebd6e6-214b-40a7-9089-619709f39d34 req-8ee7388d-d328-41a2-85b9-ec45ecfbbd1f tempest-AttachVolumeNegativeTest-457073585 tempest-AttachVolumeNegativeTest-457073585-project-member] Enqueued Resource ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf with Priority: HIGHEST for action security_group_members [ 1070.952495] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf with Priority: HIGHEST for action security_group_members [ 1070.952872] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-c936d9b1-70e6-41ff-b4fc-481a320e93bf taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.952999] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.953080] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.954429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.954429] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.954429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.954429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.954429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.954429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.954429] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c936d9b1-70e6-41ff-b4fc-481a320e93bf',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.110662] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 in Status: SUCCESS [ 1071.112799] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.112799] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.112799] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.112799] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.113268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.113268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.113268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.113268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.113268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.113456] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.458983] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.458983] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.458983] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.458983] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.458983] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.458983] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.458983] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.458983] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.458983] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.458983] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.458983] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf is going to be updated. [ 1071.496018] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.496018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.496018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.496018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.496018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.505258] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf in Status: IN_PROGRESS for 2s [ 1071.618210] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.792681] env[66834]: INFO networking_nsxv3.common.synchronization [req-6e233827-87e4-4b96-93fc-257ff3381516 req-2cca7951-b679-4c6e-983a-3512a6e9e541 tempest-ServersTestMultiNic-565362409 tempest-ServersTestMultiNic-565362409-project-member] Enqueued Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1071.793212] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1071.793604] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.793766] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.793859] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.794136] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.794327] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.794460] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.794547] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.794732] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.794911] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.794987] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.864170] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 in Status: SUCCESS [ 1071.864401] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.125026] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b33fa48-b9ca-426c-b890-67d4639035e2: rpc.has_security_group_logging(os_id): False [ 1072.146421] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.146622] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.146622] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.147384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.147384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.147384] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.147384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.147767] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.147767] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.147767] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.147889] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 is going to be updated. [ 1072.190704] env[66834]: INFO networking_nsxv3.common.synchronization [req-6e233827-87e4-4b96-93fc-257ff3381516 req-de1c0e21-a91d-4a03-b44f-d28d5f3f2f7a tempest-ServersTestMultiNic-565362409 tempest-ServersTestMultiNic-565362409-project-member] Enqueued Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1072.192753] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1072.192753] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.192753] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.297118] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.297382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.297382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.298621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.298621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.298621] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.298621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.298621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.298621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.298621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.298621] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b is going to be updated. [ 1072.320362] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.320529] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.320601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.320823] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.320970] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.345733] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 in Status: IN_PROGRESS for 2s [ 1072.366241] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.366397] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.366493] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.366684] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.366832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.385289] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: IN_PROGRESS for 2s [ 1072.711796] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-307 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.712204] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-307" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.712386] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-307" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.712816] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-307" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.713185] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.713390] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.713546] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.713827] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.714024] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.714298] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1072.714451] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1072.714598] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1072.714744] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1072.714891] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1072.715054] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1072.715234] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1072.741386] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1072.741386] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1072.742449] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1072.742449] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-307" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.742449] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-8332203e-f2b4-4681-b7e0-ccc7766c1f2d taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.742449] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-8332203e-f2b4-4681-b7e0-ccc7766c1f2d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.742449] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-8332203e-f2b4-4681-b7e0-ccc7766c1f2d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.742873] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-8332203e-f2b4-4681-b7e0-ccc7766c1f2d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.745014] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8332203e-f2b4-4681-b7e0-ccc7766c1f2d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.248039] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.248039] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.248039] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.248039] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.248039] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.248039] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 8332203e-f2b4-4681-b7e0-ccc7766c1f2d not found, creating... [ 1073.248039] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.248039] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.248766] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.248766] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.248766] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.250064] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.250064] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.250064] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.250064] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.250064] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.250064] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 8332203e-f2b4-4681-b7e0-ccc7766c1f2d is going to be created. [ 1073.271328] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.271562] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.271711] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.272042] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.272382] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.272614] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-8332203e-f2b4-4681-b7e0-ccc7766c1f2d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.353999] env[66834]: INFO networking_nsxv3.common.synchronization [None req-5282a17c-098d-4df6-a305-a52e3b232a5d tempest-AttachInterfacesTestJSON-77868371 tempest-AttachInterfacesTestJSON-77868371-project-member] Enqueued Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 1073.354554] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 1073.355191] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.355191] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.355191] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.355944] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.355944] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.355944] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.355944] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.356196] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.356196] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.356270] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.518957] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf in Status: SUCCESS [ 1073.519161] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf deletion is rescheduled due to dependency. [ 1073.519273] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.858714] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.859022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.859105] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.859559] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.859758] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.860406] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.860406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.860406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.860406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.860406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.860406] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2989937c-6050-493e-a1d8-79a52d9b6132 is going to be deleted. [ 1073.892286] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.892470] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.892470] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.893253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.893253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.893253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.984903] env[66834]: INFO networking_nsxv3.common.synchronization [req-6e233827-87e4-4b96-93fc-257ff3381516 req-3a33d35b-bf2e-4e8e-8b70-534b78ec60b3 service nova] Enqueued Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_rules [ 1073.985098] env[66834]: INFO networking_nsxv3.common.synchronization [req-6e233827-87e4-4b96-93fc-257ff3381516 req-3a33d35b-bf2e-4e8e-8b70-534b78ec60b3 service nova] Enqueued Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1073.985270] env[66834]: INFO networking_nsxv3.common.synchronization [req-6e233827-87e4-4b96-93fc-257ff3381516 req-3a33d35b-bf2e-4e8e-8b70-534b78ec60b3 service nova] Enqueued Resource ID: 8332203e-f2b4-4681-b7e0-ccc7766c1f2d with Priority: HIGHEST for action port [ 1073.985850] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_rules [ 1073.986049] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1073.986184] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8332203e-f2b4-4681-b7e0-ccc7766c1f2d with Priority: HIGHEST for action port [ 1073.986640] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.986735] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.986774] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.986982] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.987106] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.988162] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.988256] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.988471] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-8332203e-f2b4-4681-b7e0-ccc7766c1f2d taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.988593] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8332203e-f2b4-4681-b7e0-ccc7766c1f2d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.988657] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8332203e-f2b4-4681-b7e0-ccc7766c1f2d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.988859] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8332203e-f2b4-4681-b7e0-ccc7766c1f2d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.988938] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8332203e-f2b4-4681-b7e0-ccc7766c1f2d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.362900] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 in Status: SUCCESS [ 1074.363250] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.400714] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: SUCCESS [ 1074.400714] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b deletion is rescheduled due to dependency. [ 1074.400714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.401130] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.401454] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.401818] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.402027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.402131] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.403296] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.403296] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.403296] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.490447] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.490709] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.490971] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8332203e-f2b4-4681-b7e0-ccc7766c1f2d with status ACTIVE [ 1074.491217] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.491443] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.491560] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.491853] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.492027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.492259] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.492468] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.492585] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.492802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.492922] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.493331] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.493547] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.493670] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.493878] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.493979] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.494115] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8332203e-f2b4-4681-b7e0-ccc7766c1f2d is going to be updated. [ 1074.523275] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.523475] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.523614] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.524039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.524123] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.524510] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8332203e-f2b4-4681-b7e0-ccc7766c1f2d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.544746] env[66834]: INFO networking_nsxv3.common.synchronization [req-23f52aee-61bd-4b50-a647-45e880a73a7f req-f2947953-ec0a-45fd-bfae-4c370bb53cf7 tempest-DeleteServersTestJSON-1250802255 tempest-DeleteServersTestJSON-1250802255-project-member] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 1074.548031] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 1074.548814] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.548981] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.549063] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.549278] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.549429] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.549556] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.549627] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.549783] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.549898] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.550011] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.906153] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.920042] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-560 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.920042] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-560" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.920042] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-560" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.920042] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-560" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.920042] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.920667] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.923511] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.923511] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.923511] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.923511] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.923511] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1074.923511] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1074.923511] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1074.923511] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.923511] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1074.923511] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1074.946106] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1074.946356] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1074.946440] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1074.946619] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-560" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.946957] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-71f18574-a4f2-4cb1-9788-8c3d2102145d taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.947144] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-71f18574-a4f2-4cb1-9788-8c3d2102145d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.947264] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-71f18574-a4f2-4cb1-9788-8c3d2102145d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.947646] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-71f18574-a4f2-4cb1-9788-8c3d2102145d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.947786] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71f18574-a4f2-4cb1-9788-8c3d2102145d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.054010] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.054247] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.054327] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.054550] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.054645] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.054841] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.054942] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.055039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.055164] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.055239] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.055325] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be updated. [ 1075.080803] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.080944] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.081023] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.081236] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.081382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.090924] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: IN_PROGRESS for 2s [ 1075.149457] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-606 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.149817] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.149872] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.150147] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.150482] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.150537] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.150638] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.150845] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.150986] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.151202] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1075.151312] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1075.151418] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1075.151522] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1075.151644] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1075.151778] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1075.151916] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1075.169955] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1075.170137] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1075.170335] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1075.170475] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-606" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.170854] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-fabc3107-fd7a-467f-beef-9bd6128d5652 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.171049] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-fabc3107-fd7a-467f-beef-9bd6128d5652" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.171170] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-fabc3107-fd7a-467f-beef-9bd6128d5652" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.171508] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-fabc3107-fd7a-467f-beef-9bd6128d5652" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.172086] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fabc3107-fd7a-467f-beef-9bd6128d5652',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.408029] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.435251] env[66834]: INFO networking_nsxv3.common.synchronization [None req-ebd3c612-18b5-4623-bed7-9afa4192d7f1 None None] Enqueued Resource ID: 677c6840-c228-434f-b327-eff859c32162 with Priority: HIGHEST for action port [ 1075.435691] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 677c6840-c228-434f-b327-eff859c32162 with Priority: HIGHEST for action port [ 1075.436070] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-677c6840-c228-434f-b327-eff859c32162 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.436193] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-677c6840-c228-434f-b327-eff859c32162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.436264] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-677c6840-c228-434f-b327-eff859c32162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.437475] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-677c6840-c228-434f-b327-eff859c32162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.437475] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('677c6840-c228-434f-b327-eff859c32162',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.450974] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.451115] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.451219] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.451483] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.451651] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.451905] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 71f18574-a4f2-4cb1-9788-8c3d2102145d not found, creating... [ 1075.452058] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.452213] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.452328] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.452542] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.452682] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.452956] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.453262] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.453396] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.453737] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.454260] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.454260] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 71f18574-a4f2-4cb1-9788-8c3d2102145d is going to be created. [ 1075.475577] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.475777] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.475900] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.476183] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.476408] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.476626] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-71f18574-a4f2-4cb1-9788-8c3d2102145d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.674199] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.674457] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.674590] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.674891] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.675085] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.675217] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port fabc3107-fd7a-467f-beef-9bd6128d5652 not found, creating... [ 1075.675802] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.675979] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.676112] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.676356] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.676490] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.676942] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.676942] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.677108] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.677269] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.677403] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.677538] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: fabc3107-fd7a-467f-beef-9bd6128d5652 is going to be created. [ 1075.699904] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.700212] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.700366] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.700696] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.701048] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.701355] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-fabc3107-fd7a-467f-beef-9bd6128d5652" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.910602] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.910790] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.910868] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.911111] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.911202] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.911311] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b is going to be updated. [ 1075.938452] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 677c6840-c228-434f-b327-eff859c32162 [ 1075.938717] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.938925] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.938984] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.939235] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.939322] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.939420] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:677c6840-c228-434f-b327-eff859c32162 already deleted. [ 1075.939544] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-677c6840-c228-434f-b327-eff859c32162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.942358] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.942520] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.942562] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.942756] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.942886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.953437] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: IN_PROGRESS for 2s [ 1076.170550] env[66834]: INFO networking_nsxv3.common.synchronization [req-6e233827-87e4-4b96-93fc-257ff3381516 req-425ee611-f56c-4f45-b119-50c9c73c4bcb service nova] Enqueued Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_rules [ 1076.170550] env[66834]: INFO networking_nsxv3.common.synchronization [req-6e233827-87e4-4b96-93fc-257ff3381516 req-425ee611-f56c-4f45-b119-50c9c73c4bcb service nova] Enqueued Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1076.170550] env[66834]: INFO networking_nsxv3.common.synchronization [req-6e233827-87e4-4b96-93fc-257ff3381516 req-425ee611-f56c-4f45-b119-50c9c73c4bcb service nova] Enqueued Resource ID: 71f18574-a4f2-4cb1-9788-8c3d2102145d with Priority: HIGHEST for action port [ 1076.171101] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_rules [ 1076.171252] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1076.171343] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71f18574-a4f2-4cb1-9788-8c3d2102145d with Priority: HIGHEST for action port [ 1076.171829] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.171829] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.172048] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.172116] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.172290] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-71f18574-a4f2-4cb1-9788-8c3d2102145d taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.172385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71f18574-a4f2-4cb1-9788-8c3d2102145d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.172444] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71f18574-a4f2-4cb1-9788-8c3d2102145d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.172722] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71f18574-a4f2-4cb1-9788-8c3d2102145d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.172807] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71f18574-a4f2-4cb1-9788-8c3d2102145d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.429569] env[66834]: INFO networking_nsxv3.common.synchronization [req-23f52aee-61bd-4b50-a647-45e880a73a7f req-06f85726-9a18-47b8-bb67-fa3605d255a0 service nova] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_rules [ 1076.429809] env[66834]: INFO networking_nsxv3.common.synchronization [req-23f52aee-61bd-4b50-a647-45e880a73a7f req-06f85726-9a18-47b8-bb67-fa3605d255a0 service nova] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 1076.429881] env[66834]: INFO networking_nsxv3.common.synchronization [req-23f52aee-61bd-4b50-a647-45e880a73a7f req-06f85726-9a18-47b8-bb67-fa3605d255a0 service nova] Enqueued Resource ID: fabc3107-fd7a-467f-beef-9bd6128d5652 with Priority: HIGHEST for action port [ 1076.433706] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_rules [ 1076.433706] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 1076.433706] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fabc3107-fd7a-467f-beef-9bd6128d5652 with Priority: HIGHEST for action port [ 1076.433706] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.433706] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.433706] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.433706] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.433706] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.433706] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.433706] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.433706] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-fabc3107-fd7a-467f-beef-9bd6128d5652 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.433706] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fabc3107-fd7a-467f-beef-9bd6128d5652" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.433706] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fabc3107-fd7a-467f-beef-9bd6128d5652" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.433706] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fabc3107-fd7a-467f-beef-9bd6128d5652" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.433706] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fabc3107-fd7a-467f-beef-9bd6128d5652',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.679024] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71f18574-a4f2-4cb1-9788-8c3d2102145d with status ACTIVE [ 1076.679024] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.679024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.679024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.679024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.679024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.679024] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.679024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.679024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.679024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.679024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.679024] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.679024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.679024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.679024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.679024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.679024] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71f18574-a4f2-4cb1-9788-8c3d2102145d is going to be updated. [ 1076.701446] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.701446] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.701446] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.701446] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.701446] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.701446] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71f18574-a4f2-4cb1-9788-8c3d2102145d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.935478] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.935624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.935806] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fabc3107-fd7a-467f-beef-9bd6128d5652 with status ACTIVE [ 1076.935965] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.936102] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.936169] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.936391] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.936476] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.936668] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.936780] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.936846] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.937030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.937202] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.937411] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.937586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.937697] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.937844] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.938012] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.938012] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fabc3107-fd7a-467f-beef-9bd6128d5652 is going to be updated. [ 1076.960253] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.960253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.960253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.960253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.960517] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.960769] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fabc3107-fd7a-467f-beef-9bd6128d5652" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.103032] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: SUCCESS [ 1077.103032] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a deletion is rescheduled due to dependency. [ 1077.103032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.103032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.103032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.103032] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.103032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.103032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.103032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.103032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.103032] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.605729] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.965727] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: SUCCESS [ 1077.965727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.965727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.965727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.965727] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.965727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.965727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.965727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.965727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.965727] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.108779] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.237765] env[66834]: INFO networking_nsxv3.common.synchronization [None req-63ed1541-a264-4e81-a783-407b58819b8d None None] Enqueued Resource ID: d6d1c079-6e95-4b74-bc9d-7e4523363171 with Priority: HIGHEST for action port [ 1078.238375] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6d1c079-6e95-4b74-bc9d-7e4523363171 with Priority: HIGHEST for action port [ 1078.238703] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6d1c079-6e95-4b74-bc9d-7e4523363171 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.239131] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6d1c079-6e95-4b74-bc9d-7e4523363171" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.239131] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6d1c079-6e95-4b74-bc9d-7e4523363171" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.245489] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6d1c079-6e95-4b74-bc9d-7e4523363171" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.245489] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6d1c079-6e95-4b74-bc9d-7e4523363171',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.467738] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.584792] env[66834]: INFO networking_nsxv3.common.synchronization [req-781f11ce-060c-430f-a669-9babc5a98ea2 req-8fcd25f4-717b-4189-b063-8aaac5b2f461 tempest-ServersTestJSON-861266990 tempest-ServersTestJSON-861266990-project-member] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1078.585329] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1078.585624] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.585747] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.585809] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.586629] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.587676] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.587780] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.587845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.588048] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.588236] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.588327] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.611473] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.611801] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.611801] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.614269] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.614441] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.614558] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be updated. [ 1078.647108] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.647108] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.647108] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.647108] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.647108] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.656276] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: IN_PROGRESS for 2s [ 1078.746875] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d6d1c079-6e95-4b74-bc9d-7e4523363171 [ 1078.746875] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.746875] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.746875] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.747045] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.747045] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.747477] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d6d1c079-6e95-4b74-bc9d-7e4523363171 already deleted. [ 1078.747477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6d1c079-6e95-4b74-bc9d-7e4523363171" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.964030] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-849 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.964885] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.965071] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.965317] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.966246] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.966638] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.966638] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.966745] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.966886] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.967599] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1078.967599] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1078.967599] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1078.967599] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1078.967599] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1078.967890] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1078.967890] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1078.970370] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.996454] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1078.996700] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1078.996857] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1078.997138] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.997630] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-e6bbf1ce-b27c-444f-bbae-dc5d8726a7f2 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.997868] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-e6bbf1ce-b27c-444f-bbae-dc5d8726a7f2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.999514] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-e6bbf1ce-b27c-444f-bbae-dc5d8726a7f2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.999514] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-e6bbf1ce-b27c-444f-bbae-dc5d8726a7f2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.999514] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6bbf1ce-b27c-444f-bbae-dc5d8726a7f2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.092972] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.476063] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.476341] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.476426] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.476653] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.476742] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.476840] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b is going to be updated. [ 1079.502457] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.503358] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.503480] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.503761] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.503906] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.504088] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port e6bbf1ce-b27c-444f-bbae-dc5d8726a7f2 not found, creating... [ 1079.504371] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.504539] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.504669] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.504900] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.505045] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.505333] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.505485] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.505600] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.505801] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.505928] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.506857] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: e6bbf1ce-b27c-444f-bbae-dc5d8726a7f2 is going to be created. [ 1079.519905] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.520205] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.520794] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.520938] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.521131] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.531055] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: IN_PROGRESS for 2s [ 1079.532186] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.532428] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.532576] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.532895] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.533166] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.533450] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-e6bbf1ce-b27c-444f-bbae-dc5d8726a7f2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.596483] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.102287] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.102707] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.102707] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.102788] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.103875] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.103875] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be updated. [ 1080.141310] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.141497] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.141545] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.141845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.142039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.158445] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 1080.264285] env[66834]: INFO networking_nsxv3.common.synchronization [req-781f11ce-060c-430f-a669-9babc5a98ea2 req-f9987b85-5783-4652-a09e-31a8360ad9f8 service nova] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_rules [ 1080.264475] env[66834]: INFO networking_nsxv3.common.synchronization [req-781f11ce-060c-430f-a669-9babc5a98ea2 req-f9987b85-5783-4652-a09e-31a8360ad9f8 service nova] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1080.264628] env[66834]: INFO networking_nsxv3.common.synchronization [req-781f11ce-060c-430f-a669-9babc5a98ea2 req-f9987b85-5783-4652-a09e-31a8360ad9f8 service nova] Enqueued Resource ID: e6bbf1ce-b27c-444f-bbae-dc5d8726a7f2 with Priority: HIGHEST for action port [ 1080.265223] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_rules [ 1080.265359] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1080.265458] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6bbf1ce-b27c-444f-bbae-dc5d8726a7f2 with Priority: HIGHEST for action port [ 1080.265770] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.265905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.265988] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.266556] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.266661] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.268483] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.268483] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.268483] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6bbf1ce-b27c-444f-bbae-dc5d8726a7f2 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.268483] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6bbf1ce-b27c-444f-bbae-dc5d8726a7f2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.268483] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6bbf1ce-b27c-444f-bbae-dc5d8726a7f2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.268483] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6bbf1ce-b27c-444f-bbae-dc5d8726a7f2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.268483] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6bbf1ce-b27c-444f-bbae-dc5d8726a7f2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.667185] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: SUCCESS [ 1080.669399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.669399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.669399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.669399] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.669399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.669399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.669399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.669399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.669399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.669399] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.772331] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.772751] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.772932] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e6bbf1ce-b27c-444f-bbae-dc5d8726a7f2 with status ACTIVE [ 1080.772980] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.773110] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.773170] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.773372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.773458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.773679] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.773849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.773915] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.774080] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.774157] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.774338] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.774432] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.774495] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.774837] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.774894] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.775024] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e6bbf1ce-b27c-444f-bbae-dc5d8726a7f2 is going to be updated. [ 1080.797475] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.799448] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.799448] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.799448] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.799448] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.799448] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6bbf1ce-b27c-444f-bbae-dc5d8726a7f2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.173624] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.173624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.173624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.173624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.173624] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.173624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.173624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.173624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.173624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.173624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.173624] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.173624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.173624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.173624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.174419] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.174419] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.174419] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.174419] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.174419] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.174419] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.174419] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.542927] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: SUCCESS [ 1081.543175] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.543354] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.543582] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.543806] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.543932] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.544041] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.544204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.544287] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.544372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.544472] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.545418] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.545602] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.545752] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.545870] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.545958] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.546563] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.546563] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.546563] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.677718] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a15c14c6-0aee-4e9d-b481-2661c510f44a: rpc.has_security_group_logging(os_id): False [ 1081.700210] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.700397] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.700435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.700648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.700741] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.700954] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.701085] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.701134] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.701275] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.701529] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.701529] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.701724] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.701724] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.701891] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.701966] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.702227] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.702329] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.702375] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.702614] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.702832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.703018] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be updated. [ 1081.778391] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.778391] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.778391] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.779782] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.779782] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.798292] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: IN_PROGRESS for 2s [ 1082.048765] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.048959] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.049301] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.169396] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 1082.169642] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.169863] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.170117] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.170328] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.170467] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.170532] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.170706] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.170790] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.170886] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.552449] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.673091] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.058942] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.058942] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.058942] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.058942] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.058942] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.058942] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b is going to be updated. [ 1083.088547] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.089247] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.089247] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.089247] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.089247] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.099179] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: IN_PROGRESS for 2s [ 1083.175843] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.678120] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.678473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.678473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.678566] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.678658] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.678758] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be updated. [ 1083.717993] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.718537] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.718712] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.719418] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.719716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.731791] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 1083.818178] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: SUCCESS [ 1083.818178] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.801651] env[66834]: INFO networking_nsxv3.common.synchronization [None req-02a5eec7-e4b8-4cb8-8e1e-aeb38af2bec9 None None] Enqueued Resource ID: 96790fbc-a7c5-4f10-b26f-6d77b54a9192 with Priority: HIGHEST for action port [ 1084.802322] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96790fbc-a7c5-4f10-b26f-6d77b54a9192 with Priority: HIGHEST for action port [ 1084.802322] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-96790fbc-a7c5-4f10-b26f-6d77b54a9192 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.802322] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96790fbc-a7c5-4f10-b26f-6d77b54a9192" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.802322] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96790fbc-a7c5-4f10-b26f-6d77b54a9192" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.802557] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96790fbc-a7c5-4f10-b26f-6d77b54a9192" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.802633] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96790fbc-a7c5-4f10-b26f-6d77b54a9192',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.110512] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: SUCCESS [ 1085.110862] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.111160] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.111458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.111704] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.111883] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.111957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.112149] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.112235] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.112336] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.112512] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.112605] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.112708] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.112821] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.112969] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.113088] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.113150] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.113292] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.113365] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.113444] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.113531] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.305450] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96790fbc-a7c5-4f10-b26f-6d77b54a9192 [ 1085.305761] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.305937] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.305995] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.306232] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.306339] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.306449] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96790fbc-a7c5-4f10-b26f-6d77b54a9192 already deleted. [ 1085.306576] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96790fbc-a7c5-4f10-b26f-6d77b54a9192" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.447693] env[66834]: INFO networking_nsxv3.common.synchronization [None req-279de9da-1260-4ce8-bc26-a4e401aa05ea tempest-AttachVolumeShelveTestJSON-172859501 tempest-AttachVolumeShelveTestJSON-172859501-project-member] Enqueued Resource ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 with Priority: HIGHEST for action security_group_rules [ 1085.451103] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 with Priority: HIGHEST for action security_group_rules [ 1085.451103] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c70a4c8a-c207-4934-8f56-cd2de91f4fb1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.451103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.451103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.451103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.451103] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c70a4c8a-c207-4934-8f56-cd2de91f4fb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.547150] env[66834]: INFO networking_nsxv3.common.synchronization [None req-544feed2-8db4-48fa-8ffb-d966002922ab tempest-AttachVolumeShelveTestJSON-172859501 tempest-AttachVolumeShelveTestJSON-172859501-project-member] Enqueued Resource ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 with Priority: HIGHEST for action security_group_rules [ 1085.547603] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 with Priority: HIGHEST for action security_group_rules [ 1085.547950] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c70a4c8a-c207-4934-8f56-cd2de91f4fb1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.548316] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.616939] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b: rpc.has_security_group_logging(os_id): False [ 1085.637822] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.637959] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.638027] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.638316] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.638462] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.638680] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.638812] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.638872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.639061] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.639162] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.639378] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.639478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.639535] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.639677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.639768] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.639955] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.640137] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.640137] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.640930] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.640930] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.640930] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b is going to be updated. [ 1085.711025] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.711025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.711025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.711025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.711025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.736389] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: IN_PROGRESS for 2s [ 1085.748012] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 1085.748012] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.748207] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.748408] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.748852] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.748981] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.749063] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.749214] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.749622] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.749768] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.749870] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.972803] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.973142] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.973418] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.973938] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.973938] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.973938] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 already deleted. [ 1085.974117] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.974294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.976632] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.976632] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c70a4c8a-c207-4934-8f56-cd2de91f4fb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.252837] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.253043] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.253129] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.253350] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.253525] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.253640] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.253707] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.254228] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.254349] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.254455] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.254614] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.254711] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.254773] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.254930] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.255084] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.255179] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.255241] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.255380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.255462] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.255544] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.255632] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.501854] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.501854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.501854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.501854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.501854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.501854] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 already deleted. [ 1086.501854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.758979] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c88662f-4694-4988-b716-56b85d22f3c9: rpc.has_security_group_logging(os_id): False [ 1086.780143] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.780588] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.782992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.782992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.782992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.782992] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.782992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.782992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.782992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.782992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.782992] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.782992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.782992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.782992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.783843] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.784250] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.784458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.784592] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.784803] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.788545] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.788545] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be updated. [ 1086.864399] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.864399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.864399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.864399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.864399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.884194] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 1087.545895] env[66834]: INFO networking_nsxv3.common.synchronization [None req-ff1db0f4-0bfa-4126-b665-166c0a5b0448 None None] Enqueued Resource ID: f26d7e64-28c6-484a-9a85-c06c133049a7 with Priority: HIGHEST for action port [ 1087.546436] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f26d7e64-28c6-484a-9a85-c06c133049a7 with Priority: HIGHEST for action port [ 1087.546736] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-f26d7e64-28c6-484a-9a85-c06c133049a7 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.546863] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f26d7e64-28c6-484a-9a85-c06c133049a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.546934] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f26d7e64-28c6-484a-9a85-c06c133049a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.547328] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f26d7e64-28c6-484a-9a85-c06c133049a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.547419] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f26d7e64-28c6-484a-9a85-c06c133049a7',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.757156] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: SUCCESS [ 1087.757454] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.757699] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.757967] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.758117] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.049816] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f26d7e64-28c6-484a-9a85-c06c133049a7 [ 1088.050120] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.050384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.050471] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.050714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.050849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.050891] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f26d7e64-28c6-484a-9a85-c06c133049a7 already deleted. [ 1088.050978] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f26d7e64-28c6-484a-9a85-c06c133049a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.260462] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.260746] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.260873] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.261225] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.261468] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.261608] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.261700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.262024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.262155] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.262283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.262415] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.764518] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.764983] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.764983] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.764983] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.765184] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.765289] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.765366] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.765520] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.765606] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.765694] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.765844] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.765940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.765997] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.766155] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.766309] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.766484] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.766484] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.766582] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.766661] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.766740] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.766830] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.907495] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 1088.907780] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.269757] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b: rpc.has_security_group_logging(os_id): False [ 1089.289100] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.289321] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.289321] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.289533] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.289621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.289844] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.289946] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.290016] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.290172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.290250] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.290446] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.290548] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.290639] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.290747] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.290847] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.290998] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.291106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.291165] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.291304] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.291375] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.291462] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b is going to be updated. [ 1089.380930] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.380930] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.380930] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.380930] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.380930] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.406840] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: IN_PROGRESS for 2s [ 1089.957360] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-106 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.957664] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.957729] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.957988] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.958262] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.958416] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.958704] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.958771] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.958924] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.959154] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1089.959265] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1089.959371] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1089.959477] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1089.959582] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1089.959789] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1089.959839] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1089.984059] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1089.984342] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1089.984529] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1089.984719] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.985076] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-b3072193-556a-4bc4-94a3-7f801cdab907 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.985294] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-b3072193-556a-4bc4-94a3-7f801cdab907" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.985396] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-b3072193-556a-4bc4-94a3-7f801cdab907" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.985726] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-b3072193-556a-4bc4-94a3-7f801cdab907" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.985935] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3072193-556a-4bc4-94a3-7f801cdab907',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.404029] env[66834]: INFO networking_nsxv3.common.synchronization [req-0550dbf1-d2c9-4bfa-8cb5-3271e480b666 req-1c8aa7f3-9373-49d5-9606-e917a536d7fd tempest-AttachVolumeNegativeTest-457073585 tempest-AttachVolumeNegativeTest-457073585-project-member] Enqueued Resource ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 with Priority: HIGHEST for action security_group_members [ 1090.404481] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 with Priority: HIGHEST for action security_group_members [ 1090.404808] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ac1b684-ee07-41f3-926b-106a37b82e05 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.404989] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.405243] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.405334] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.405510] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.405638] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.405722] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.405890] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.405994] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.406124] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ac1b684-ee07-41f3-926b-106a37b82e05',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.488475] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.488747] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.488947] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.489373] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.489719] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.490097] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port b3072193-556a-4bc4-94a3-7f801cdab907 not found, creating... [ 1090.490403] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.490583] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.490703] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.490954] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.491111] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.491404] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.491579] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.491696] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.491987] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.492142] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.492282] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: b3072193-556a-4bc4-94a3-7f801cdab907 is going to be created. [ 1090.514975] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.515204] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.515340] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.515615] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.515841] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.516078] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-b3072193-556a-4bc4-94a3-7f801cdab907" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.768437] env[66834]: INFO networking_nsxv3.common.synchronization [req-1bbfc20e-9d86-4e67-b5d8-c825fe332c70 req-e0f6b25a-a793-40e6-85ff-daf66ac342ec tempest-ServersTestMultiNic-565362409 tempest-ServersTestMultiNic-565362409-project-member] Enqueued Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1090.768978] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1090.770339] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.770339] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.770339] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.770339] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.770339] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.770339] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.770339] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.770339] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.770339] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.770339] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.909038] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.909038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.909038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.909379] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.909379] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.909379] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.909499] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.909532] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.909725] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.909725] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.910043] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 is going to be updated. [ 1090.936455] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.936626] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.936670] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.937079] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.937079] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.945696] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 in Status: IN_PROGRESS for 2s [ 1090.962842] env[66834]: INFO networking_nsxv3.common.synchronization [req-1bbfc20e-9d86-4e67-b5d8-c825fe332c70 req-d34959e9-41a2-4bbe-944e-6b3a52b2f078 tempest-ServersTestMultiNic-565362409 tempest-ServersTestMultiNic-565362409-project-member] Enqueued Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1090.963446] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGHEST for action security_group_members [ 1090.963758] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.963861] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.199457] env[66834]: INFO networking_nsxv3.common.synchronization [req-4daf871f-0ed3-4acf-8340-7ec3aef3a1e7 req-779baaee-d81f-4067-9702-9e3f8ad943fc tempest-ServersNegativeTestJSON-499609681 tempest-ServersNegativeTestJSON-499609681-project-member] Enqueued Resource ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c with Priority: HIGHEST for action security_group_members [ 1091.204374] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c with Priority: HIGHEST for action security_group_members [ 1091.204754] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.204893] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.204981] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.205187] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.205342] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.205487] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.205487] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.205643] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.205731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.206665] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.214623] env[66834]: INFO networking_nsxv3.common.synchronization [req-72886422-1b70-48a6-9fc6-b70d9356c5b9 req-12ec4c69-d0e8-4c77-a342-4ab7c444b1a6 service nova] Enqueued Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_rules [ 1091.215051] env[66834]: INFO networking_nsxv3.common.synchronization [req-72886422-1b70-48a6-9fc6-b70d9356c5b9 req-12ec4c69-d0e8-4c77-a342-4ab7c444b1a6 service nova] Enqueued Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 1091.215051] env[66834]: INFO networking_nsxv3.common.synchronization [req-72886422-1b70-48a6-9fc6-b70d9356c5b9 req-12ec4c69-d0e8-4c77-a342-4ab7c444b1a6 service nova] Enqueued Resource ID: b3072193-556a-4bc4-94a3-7f801cdab907 with Priority: HIGHEST for action port [ 1091.215156] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_rules [ 1091.215349] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 1091.215349] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3072193-556a-4bc4-94a3-7f801cdab907 with Priority: HIGHEST for action port [ 1091.216496] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.216496] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.216496] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.216496] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.216633] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.217929] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.218146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.218213] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.218464] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.218694] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.218805] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.218946] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.219117] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.219285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.219378] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.220934] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3072193-556a-4bc4-94a3-7f801cdab907 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.221095] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3072193-556a-4bc4-94a3-7f801cdab907" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.221511] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3072193-556a-4bc4-94a3-7f801cdab907" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.221775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3072193-556a-4bc4-94a3-7f801cdab907" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.223031] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3072193-556a-4bc4-94a3-7f801cdab907',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.271687] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.431874] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: SUCCESS [ 1091.432117] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.558623] env[66834]: INFO networking_nsxv3.common.synchronization [req-dcdb1cac-b814-489c-908b-45f2463e6dfe req-658fd742-4b8a-469c-beb9-05c12fc905c8 tempest-AttachVolumeShelveTestJSON-172859501 tempest-AttachVolumeShelveTestJSON-172859501-project-member] Enqueued Resource ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 with Priority: HIGHEST for action security_group_members [ 1091.559772] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 with Priority: HIGHEST for action security_group_members [ 1091.559772] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.559772] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.559772] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.560066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.560066] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.560232] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.560571] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.561030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.561030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.561030] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c70a4c8a-c207-4934-8f56-cd2de91f4fb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.710463] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.710623] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.710704] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.710975] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.711084] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.711286] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.711386] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.711452] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.711633] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.711706] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.711791] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c is going to be updated. [ 1091.725158] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.725274] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.725428] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.726536] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3072193-556a-4bc4-94a3-7f801cdab907 with status ACTIVE [ 1091.727379] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.727379] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.727379] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.727379] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.727379] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.727575] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.727575] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.727746] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.727807] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.727909] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.728145] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.728280] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.728356] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.728534] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.728646] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.728744] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3072193-556a-4bc4-94a3-7f801cdab907 is going to be updated. [ 1091.756483] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.756649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.756649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.756946] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.757186] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.757675] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3072193-556a-4bc4-94a3-7f801cdab907" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.758773] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.759029] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.759111] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.759306] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.759495] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.773962] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.781438] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c in Status: IN_PROGRESS for 2s [ 1091.869891] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.870230] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-557" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.870380] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-557" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.870668] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-557" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.870970] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.871216] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.871420] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.871779] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.873046] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.873046] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1091.873046] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1091.873046] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1091.873046] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1091.873256] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1091.873347] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1091.873486] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1091.894893] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1091.895097] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1091.895235] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1091.895416] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-557" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.895746] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-2eac96d3-ba04-4eda-9c03-38b3a0153910 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.895922] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-2eac96d3-ba04-4eda-9c03-38b3a0153910" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.896092] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-2eac96d3-ba04-4eda-9c03-38b3a0153910" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.896404] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-2eac96d3-ba04-4eda-9c03-38b3a0153910" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.896542] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2eac96d3-ba04-4eda-9c03-38b3a0153910',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.064091] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.064091] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.064091] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.064091] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.064640] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.064640] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.065119] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.065119] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.065119] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.065119] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.065283] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 already deleted. [ 1092.065557] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.231172] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.277380] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.277607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.277709] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.278110] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.278315] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.278595] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b is going to be updated. [ 1092.317280] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.317470] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.317470] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.318927] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.318927] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.332909] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: IN_PROGRESS for 2s [ 1092.399036] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.399290] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.399418] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.399713] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.399862] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.400029] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 2eac96d3-ba04-4eda-9c03-38b3a0153910 not found, creating... [ 1092.400302] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.400471] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.400566] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.400775] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.400909] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.401215] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.401373] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.401484] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.401679] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.401806] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.401988] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 2eac96d3-ba04-4eda-9c03-38b3a0153910 is going to be created. [ 1092.430037] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.430300] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.430427] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.430733] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.430967] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.431218] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-2eac96d3-ba04-4eda-9c03-38b3a0153910" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.735038] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.735038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.735038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.735038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.735316] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.735316] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2989937c-6050-493e-a1d8-79a52d9b6132 is going to be created. [ 1092.764596] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.764775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.764813] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.765028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.765201] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.776269] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: UNINITIALIZED for 2s [ 1092.961731] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 in Status: SUCCESS [ 1092.962008] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 deletion is rescheduled due to dependency. [ 1092.962135] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.149850] env[66834]: INFO networking_nsxv3.common.synchronization [req-dcdb1cac-b814-489c-908b-45f2463e6dfe req-72b9e218-994e-4e53-92f8-50b95298b23d service nova] Enqueued Resource ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 with Priority: HIGHEST for action security_group_rules [ 1093.149850] env[66834]: INFO networking_nsxv3.common.synchronization [req-dcdb1cac-b814-489c-908b-45f2463e6dfe req-72b9e218-994e-4e53-92f8-50b95298b23d service nova] Enqueued Resource ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 with Priority: HIGHEST for action security_group_members [ 1093.149850] env[66834]: INFO networking_nsxv3.common.synchronization [req-dcdb1cac-b814-489c-908b-45f2463e6dfe req-72b9e218-994e-4e53-92f8-50b95298b23d service nova] Enqueued Resource ID: 2eac96d3-ba04-4eda-9c03-38b3a0153910 with Priority: HIGHEST for action port [ 1093.149850] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 with Priority: HIGHEST for action security_group_rules [ 1093.149850] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 with Priority: HIGHEST for action security_group_members [ 1093.149850] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eac96d3-ba04-4eda-9c03-38b3a0153910 with Priority: HIGHEST for action port [ 1093.149850] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c70a4c8a-c207-4934-8f56-cd2de91f4fb1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.149850] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.149850] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.149850] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.149850] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c70a4c8a-c207-4934-8f56-cd2de91f4fb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.150894] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.150894] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.150894] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.151078] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.151389] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.151389] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.151389] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.151517] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.151608] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.151659] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c70a4c8a-c207-4934-8f56-cd2de91f4fb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.153137] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-2eac96d3-ba04-4eda-9c03-38b3a0153910 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.153137] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2eac96d3-ba04-4eda-9c03-38b3a0153910" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.153137] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2eac96d3-ba04-4eda-9c03-38b3a0153910" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.153137] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2eac96d3-ba04-4eda-9c03-38b3a0153910" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.153137] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2eac96d3-ba04-4eda-9c03-38b3a0153910',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.656061] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c70a4c8a-c207-4934-8f56-cd2de91f4fb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.656973] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.657093] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.657334] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2eac96d3-ba04-4eda-9c03-38b3a0153910 with status ACTIVE [ 1093.657525] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.657640] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.657704] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.657912] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.657999] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.658229] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.658304] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.658354] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.658472] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.658540] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.658716] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.658799] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.658859] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.659018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.659101] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.659188] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2eac96d3-ba04-4eda-9c03-38b3a0153910 is going to be updated. [ 1093.679607] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.679857] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.679857] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.680140] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.680304] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.680507] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2eac96d3-ba04-4eda-9c03-38b3a0153910" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.792565] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c in Status: SUCCESS [ 1093.792766] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c deletion is rescheduled due to dependency. [ 1093.792875] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.161680] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c70a4c8a-c207-4934-8f56-cd2de91f4fb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.344136] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: SUCCESS [ 1094.344329] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.344458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.344691] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.344890] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.345030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.345123] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.345262] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.345340] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.345450] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.371658] env[66834]: INFO networking_nsxv3.common.synchronization [req-61958f49-f26e-4482-b1be-16304bcc10cb req-8da27c9c-77fb-4b4e-974b-d92b6bcda64a tempest-ServersTestJSON-861266990 tempest-ServersTestJSON-861266990-project-member] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1094.372287] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1094.372613] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.372736] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.372816] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.373076] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.373248] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.373371] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.373438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.373632] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.373748] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.373851] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.666066] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.666066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.666250] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.666330] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.666439] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.666512] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 is going to be created. [ 1094.691296] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.691484] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.691544] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.691858] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.692142] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.702494] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 in Status: UNINITIALIZED for 2s [ 1094.786959] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: SUCCESS [ 1094.786959] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.786959] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.786959] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.787255] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.787255] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.787255] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.787428] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.787512] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.787593] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.787684] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.847946] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.848152] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.848218] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.848452] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.848579] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.848757] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.848855] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.848919] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.849227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.849227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.849319] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b is going to be updated. [ 1094.877453] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.889960] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.889960] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.889960] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.890216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.890288] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.906025] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: IN_PROGRESS for 2s [ 1095.291323] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.291754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.291754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.291754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.291989] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.292175] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.292240] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.292407] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.292498] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.292589] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.292737] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.292827] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.292903] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.293078] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.293222] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.293315] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.293378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.293519] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.293597] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.293678] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.293764] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.380390] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.630194] env[66834]: INFO networking_nsxv3.common.synchronization [None req-00586d6d-0de9-4b78-90e6-587129a0f9b5 tempest-AttachVolumeNegativeTest-457073585 tempest-AttachVolumeNegativeTest-457073585-project-member] Enqueued Resource ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 with Priority: HIGHEST for action security_group_rules [ 1095.630454] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 with Priority: HIGHEST for action security_group_rules [ 1095.630808] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97cde620-d9a0-41c2-bb19-1e22ef3bc452 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.630964] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.631021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.631303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.631389] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97cde620-d9a0-41c2-bb19-1e22ef3bc452',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.723713] env[66834]: INFO networking_nsxv3.common.synchronization [None req-7bb0bea4-5004-424e-8682-506cab5a7227 tempest-AttachVolumeNegativeTest-457073585 tempest-AttachVolumeNegativeTest-457073585-project-member] Enqueued Resource ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 with Priority: HIGHEST for action security_group_rules [ 1095.724561] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 with Priority: HIGHEST for action security_group_rules [ 1095.725328] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97cde620-d9a0-41c2-bb19-1e22ef3bc452 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.725727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.797211] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2989937c-6050-493e-a1d8-79a52d9b6132: rpc.has_security_group_logging(os_id): False [ 1095.818433] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.818640] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.818686] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.818913] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.819013] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.819280] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.819410] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.819450] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.819619] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.819699] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.820082] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.820214] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.820288] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.820455] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.820538] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.820729] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.820830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.820895] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.824283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.824398] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.824504] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2989937c-6050-493e-a1d8-79a52d9b6132 is going to be created. [ 1095.885452] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.885691] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.885812] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.886373] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.886373] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.886373] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be updated. [ 1095.889961] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.890204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.890204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.890372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.890542] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.915095] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: IN_PROGRESS for 2s [ 1095.920655] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.920852] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.920852] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.921351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.921351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.931868] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 1096.156579] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.156579] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.156579] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.156579] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.156579] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.156579] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 already deleted. [ 1096.156579] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.156579] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.156579] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.156956] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97cde620-d9a0-41c2-bb19-1e22ef3bc452',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.682026] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.682026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.682026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.682026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.682026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.682026] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 already deleted. [ 1096.682026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.726158] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 in Status: SUCCESS [ 1096.726451] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.726583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.726780] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.726975] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.727341] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.727341] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.727341] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.727429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.727466] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.727557] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c70a4c8a-c207-4934-8f56-cd2de91f4fb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.917752] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b in Status: SUCCESS [ 1096.917920] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b deletion is rescheduled due to dependency. [ 1096.918052] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.123705] env[66834]: INFO networking_nsxv3.common.synchronization [req-7191c58f-3fb1-46eb-b286-3f521e9d3ab1 req-7d90faaa-3ddb-4013-870e-a9be742cc8d2 tempest-ServerActionsTestOtherB-2089780499 tempest-ServerActionsTestOtherB-2089780499-project-member] Enqueued Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_members [ 1097.124384] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_members [ 1097.124717] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06251551-417e-4f8a-9412-fdb5036f57fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.126037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.126037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.126037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.126037] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.126037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.126037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.126037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.126037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.126037] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.230879] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c70a4c8a-c207-4934-8f56-cd2de91f4fb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.628916] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.629070] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.629272] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.629458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.651417] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.651417] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.651417] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.651417] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.651893] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.651893] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.651893] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06251551-417e-4f8a-9412-fdb5036f57fe is going to be updated. [ 1097.685227] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.685591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.685591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.685652] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.685779] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.698683] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: IN_PROGRESS for 2s [ 1097.734239] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c70a4c8a-c207-4934-8f56-cd2de91f4fb1: rpc.has_security_group_logging(os_id): False [ 1097.756360] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.756360] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.756360] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.756360] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.756360] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.756360] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.756360] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.756360] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.756360] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.756360] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.756360] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 is going to be created. [ 1097.821808] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.822091] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.823106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.823106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.823106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.838191] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 in Status: IN_PROGRESS for 2s [ 1097.943600] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 1097.943600] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.948325] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: SUCCESS [ 1097.948325] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.709919] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: SUCCESS [ 1099.709919] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06251551-417e-4f8a-9412-fdb5036f57fe deletion is rescheduled due to dependency. [ 1099.709919] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.849270] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 in Status: SUCCESS [ 1099.849497] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.125575] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1102.125904] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1103.203459] env[66834]: INFO networking_nsxv3.common.synchronization [req-dd9aeffe-2266-4c06-87df-c0ddf497b756 req-a7077e71-f313-46b7-ac0d-7f6366594518 tempest-AttachVolumeNegativeTest-457073585 tempest-AttachVolumeNegativeTest-457073585-project-member] Enqueued Resource ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 with Priority: HIGHEST for action security_group_members [ 1103.204042] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 with Priority: HIGHEST for action security_group_members [ 1103.204375] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-97cde620-d9a0-41c2-bb19-1e22ef3bc452 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.204607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.204607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.204884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.204999] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.205129] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.205226] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.205345] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.205479] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.205523] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97cde620-d9a0-41c2-bb19-1e22ef3bc452',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.531224] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-490 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.531433] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-490" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.531593] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-490" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.531919] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-490" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.532272] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.532419] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.532566] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.532834] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.533014] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.533266] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1103.533404] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1103.533526] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1103.533655] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1103.533778] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1103.533903] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1103.534071] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1103.556337] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1103.556557] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1103.556733] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1103.556957] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-490" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.557369] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-71d87de3-c890-4d73-ae80-32c56f820453 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.557643] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-71d87de3-c890-4d73-ae80-32c56f820453" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.557777] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-71d87de3-c890-4d73-ae80-32c56f820453" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.558129] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-71d87de3-c890-4d73-ae80-32c56f820453" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.558319] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71d87de3-c890-4d73-ae80-32c56f820453',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.708322] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.708487] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.708530] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.708739] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.708830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.709072] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.709167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.709234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.709388] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.709462] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.709547] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 already deleted. [ 1103.709628] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.777217] env[66834]: INFO networking_nsxv3.common.synchronization [req-5cb7730b-b661-4bb7-ad4e-2fa7daaa1e13 req-43f832d0-c21a-4982-a61b-8a09a03212b5 tempest-ServersTestJSON-861266990 tempest-ServersTestJSON-861266990-project-member] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1103.777414] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1103.778064] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.778064] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.778208] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.778390] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.778541] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.778642] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.778709] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.778885] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.778970] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.779156] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.060426] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.060746] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.060886] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.061278] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.061481] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.061662] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 71d87de3-c890-4d73-ae80-32c56f820453 not found, creating... [ 1104.061947] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.062199] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.062356] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.062623] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.062762] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.063086] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.063287] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.063412] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.063623] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.063755] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.063950] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 71d87de3-c890-4d73-ae80-32c56f820453 is going to be created. [ 1104.086057] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.086286] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.086412] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.086684] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.087035] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.087326] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-71d87de3-c890-4d73-ae80-32c56f820453" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.281790] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.784302] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.786624] env[66834]: INFO networking_nsxv3.common.synchronization [req-dd9aeffe-2266-4c06-87df-c0ddf497b756 req-3e07afb1-8f76-417b-9741-336355d9f584 service nova] Enqueued Resource ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 with Priority: HIGHEST for action security_group_rules [ 1104.787734] env[66834]: INFO networking_nsxv3.common.synchronization [req-dd9aeffe-2266-4c06-87df-c0ddf497b756 req-3e07afb1-8f76-417b-9741-336355d9f584 service nova] Enqueued Resource ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 with Priority: HIGHEST for action security_group_members [ 1104.787734] env[66834]: INFO networking_nsxv3.common.synchronization [req-dd9aeffe-2266-4c06-87df-c0ddf497b756 req-3e07afb1-8f76-417b-9741-336355d9f584 service nova] Enqueued Resource ID: 71d87de3-c890-4d73-ae80-32c56f820453 with Priority: HIGHEST for action port [ 1104.787734] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 with Priority: HIGHEST for action security_group_rules [ 1104.787734] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 with Priority: HIGHEST for action security_group_members [ 1104.787734] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71d87de3-c890-4d73-ae80-32c56f820453 with Priority: HIGHEST for action port [ 1104.788049] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97cde620-d9a0-41c2-bb19-1e22ef3bc452 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.790956] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.791044] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.791311] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.791400] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97cde620-d9a0-41c2-bb19-1e22ef3bc452',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.792319] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-97cde620-d9a0-41c2-bb19-1e22ef3bc452 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.792439] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.792503] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.792680] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.792836] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.792932] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.793011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.793177] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.793263] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.793352] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97cde620-d9a0-41c2-bb19-1e22ef3bc452',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.796468] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-71d87de3-c890-4d73-ae80-32c56f820453 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.796593] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71d87de3-c890-4d73-ae80-32c56f820453" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.796663] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71d87de3-c890-4d73-ae80-32c56f820453" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.796815] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71d87de3-c890-4d73-ae80-32c56f820453" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.796887] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71d87de3-c890-4d73-ae80-32c56f820453',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.288789] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.288789] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.289183] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.289183] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.289258] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.289296] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be updated. [ 1105.299038] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71d87de3-c890-4d73-ae80-32c56f820453 with status ACTIVE [ 1105.299318] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.299511] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.299583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.299786] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.299916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.300182] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.300264] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.300295] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.300453] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.300533] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.300745] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.300840] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.300898] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.301051] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.301129] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.301212] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71d87de3-c890-4d73-ae80-32c56f820453 is going to be updated. [ 1105.302408] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-97cde620-d9a0-41c2-bb19-1e22ef3bc452 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.302519] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.302607] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('97cde620-d9a0-41c2-bb19-1e22ef3bc452',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.319402] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.319546] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.319616] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.319818] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.319965] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.325377] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.325517] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.325557] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.325793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.325923] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.326085] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71d87de3-c890-4d73-ae80-32c56f820453" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.334891] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 1105.806467] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('97cde620-d9a0-41c2-bb19-1e22ef3bc452',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.309350] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.309662] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.309662] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.310076] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.310076] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.310200] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 is going to be created. [ 1106.332857] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.333106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.333106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.333320] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.333482] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.344275] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 in Status: UNINITIALIZED for 2s [ 1107.345277] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 1107.345547] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.690525] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-106 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.690711] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.690831] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.691135] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.691374] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.691566] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.691820] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.692083] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.692270] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.692594] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.692594] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1107.692691] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1107.692781] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1107.692889] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.692991] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1107.693131] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1107.715507] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1107.715727] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1107.715840] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1107.715972] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-106" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.716313] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-b3072193-556a-4bc4-94a3-7f801cdab907 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.716487] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-b3072193-556a-4bc4-94a3-7f801cdab907" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.716604] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-b3072193-556a-4bc4-94a3-7f801cdab907" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.716880] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-b3072193-556a-4bc4-94a3-7f801cdab907" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.717068] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3072193-556a-4bc4-94a3-7f801cdab907',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.219773] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.220020] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.220176] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.220476] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.220676] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.220924] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.221098] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.221252] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.221434] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.221581] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.221859] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.222029] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.222197] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.222419] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.222551] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.222693] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: b3072193-556a-4bc4-94a3-7f801cdab907 is going to be updated. [ 1108.244223] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.244461] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.244575] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.244867] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.245075] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.245302] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-b3072193-556a-4bc4-94a3-7f801cdab907" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.355187] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 in Status: SUCCESS [ 1108.355522] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.355578] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.355789] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.355976] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.356110] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.356174] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.356328] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.356406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.356488] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.356580] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('97cde620-d9a0-41c2-bb19-1e22ef3bc452',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.858624] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('97cde620-d9a0-41c2-bb19-1e22ef3bc452',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.951356] env[66834]: INFO networking_nsxv3.common.synchronization [req-8e45900e-2821-428e-89f3-aa1071e26378 req-3f87c1f9-16a4-4e5b-9949-03a7f6a6ba52 service nova] Enqueued Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_rules [ 1108.951541] env[66834]: INFO networking_nsxv3.common.synchronization [req-8e45900e-2821-428e-89f3-aa1071e26378 req-3f87c1f9-16a4-4e5b-9949-03a7f6a6ba52 service nova] Enqueued Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 1108.951690] env[66834]: INFO networking_nsxv3.common.synchronization [req-8e45900e-2821-428e-89f3-aa1071e26378 req-3f87c1f9-16a4-4e5b-9949-03a7f6a6ba52 service nova] Enqueued Resource ID: b3072193-556a-4bc4-94a3-7f801cdab907 with Priority: HIGHEST for action port [ 1108.952231] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_rules [ 1108.952363] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 1108.952649] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3072193-556a-4bc4-94a3-7f801cdab907 with Priority: HIGHEST for action port [ 1108.953827] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.953960] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.954055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.954229] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.954334] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.955193] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.955326] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.956242] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.956242] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.956242] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.956242] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.956242] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.956242] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.956839] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.956984] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.957788] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3072193-556a-4bc4-94a3-7f801cdab907 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.957889] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3072193-556a-4bc4-94a3-7f801cdab907" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.957953] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3072193-556a-4bc4-94a3-7f801cdab907" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.958119] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3072193-556a-4bc4-94a3-7f801cdab907" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.958187] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3072193-556a-4bc4-94a3-7f801cdab907',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.362091] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 97cde620-d9a0-41c2-bb19-1e22ef3bc452: rpc.has_security_group_logging(os_id): False [ 1109.379756] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.379957] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.380018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.380234] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.380321] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.380565] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.380665] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.380728] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.380876] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.380971] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.381050] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 is going to be created. [ 1109.437910] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.438086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.438131] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.438338] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.438517] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.450756] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 in Status: IN_PROGRESS for 2s [ 1109.460318] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.461665] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.461746] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.461897] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3072193-556a-4bc4-94a3-7f801cdab907 with status ACTIVE [ 1109.462107] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.462240] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.462341] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.462507] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.462595] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.462759] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.462854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.462916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.463092] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.463239] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.463427] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.463521] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.463605] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.463716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.463790] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.463873] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3072193-556a-4bc4-94a3-7f801cdab907 is going to be updated. [ 1109.491842] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.492035] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.492113] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.492425] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.492567] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.492731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3072193-556a-4bc4-94a3-7f801cdab907" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.966845] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.240498] env[66834]: INFO networking_nsxv3.common.synchronization [req-0f513b3b-6036-4ace-981d-b7ca4ac0bd9e req-d127223f-d37d-410a-916f-989f325caf74 tempest-ServerActionsTestOtherB-2089780499 tempest-ServerActionsTestOtherB-2089780499-project-member] Enqueued Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_members [ 1110.240938] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_members [ 1110.241382] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06251551-417e-4f8a-9412-fdb5036f57fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.241513] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.241626] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.241932] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.242241] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.242420] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.242540] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.242820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.242953] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.243071] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.469528] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.469848] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.469848] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.470047] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.470183] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.470342] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2989937c-6050-493e-a1d8-79a52d9b6132 is going to be updated. [ 1110.501909] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.502073] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.502073] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.502363] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.502505] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.513392] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: IN_PROGRESS for 2s [ 1110.537356] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.537576] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-608" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.537696] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-608" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.537950] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-608" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.538225] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.538376] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.538489] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.538697] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.538838] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.539049] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1110.539162] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1110.539268] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1110.539419] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1110.539585] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1110.539717] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1110.539849] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1110.557388] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1110.557548] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1110.557685] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1110.557857] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-608" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.558188] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-20b6010b-150c-4231-8d8a-f73b6791118c taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.558375] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-20b6010b-150c-4231-8d8a-f73b6791118c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.558491] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-20b6010b-150c-4231-8d8a-f73b6791118c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.558797] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-20b6010b-150c-4231-8d8a-f73b6791118c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.558931] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20b6010b-150c-4231-8d8a-f73b6791118c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.746092] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.746246] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.746327] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.746529] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.746622] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.746832] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.746958] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.747052] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.747133] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.747197] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.747284] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06251551-417e-4f8a-9412-fdb5036f57fe is going to be updated. [ 1110.778035] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.778201] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.778268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.778474] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.778669] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.788118] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: IN_PROGRESS for 2s [ 1111.060951] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.061157] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.061262] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.061554] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.061702] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.061855] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 20b6010b-150c-4231-8d8a-f73b6791118c not found, creating... [ 1111.062147] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.062314] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.062447] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.062644] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.062776] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.063061] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.063218] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.063332] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.063534] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.063661] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.063810] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 20b6010b-150c-4231-8d8a-f73b6791118c is going to be created. [ 1111.083651] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.083852] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.083972] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.084261] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.084489] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.084709] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-20b6010b-150c-4231-8d8a-f73b6791118c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.463997] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 in Status: SUCCESS [ 1111.464317] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.794575] env[66834]: INFO networking_nsxv3.common.synchronization [req-0f513b3b-6036-4ace-981d-b7ca4ac0bd9e req-d82cb921-7bcd-4c6e-a97b-207762d65fb2 service nova] Enqueued Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_rules [ 1111.794858] env[66834]: INFO networking_nsxv3.common.synchronization [req-0f513b3b-6036-4ace-981d-b7ca4ac0bd9e req-d82cb921-7bcd-4c6e-a97b-207762d65fb2 service nova] Enqueued Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_members [ 1111.795468] env[66834]: INFO networking_nsxv3.common.synchronization [req-0f513b3b-6036-4ace-981d-b7ca4ac0bd9e req-d82cb921-7bcd-4c6e-a97b-207762d65fb2 service nova] Enqueued Resource ID: 20b6010b-150c-4231-8d8a-f73b6791118c with Priority: HIGHEST for action port [ 1111.796289] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_rules [ 1111.796373] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_members [ 1111.796550] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20b6010b-150c-4231-8d8a-f73b6791118c with Priority: HIGHEST for action port [ 1111.796856] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06251551-417e-4f8a-9412-fdb5036f57fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.796985] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.797068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.797278] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.797404] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.798575] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06251551-417e-4f8a-9412-fdb5036f57fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.798693] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.798989] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-20b6010b-150c-4231-8d8a-f73b6791118c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.799140] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20b6010b-150c-4231-8d8a-f73b6791118c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.799293] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20b6010b-150c-4231-8d8a-f73b6791118c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.800200] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20b6010b-150c-4231-8d8a-f73b6791118c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.800200] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20b6010b-150c-4231-8d8a-f73b6791118c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.301160] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06251551-417e-4f8a-9412-fdb5036f57fe taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.301397] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.301498] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 20b6010b-150c-4231-8d8a-f73b6791118c with status ACTIVE [ 1112.301626] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.301732] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.301797] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.302106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.302254] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.302458] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.302532] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.302631] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.302743] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.302857] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.302990] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.303087] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.303153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.303293] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.303364] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.303447] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 20b6010b-150c-4231-8d8a-f73b6791118c is going to be updated. [ 1112.329321] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.329516] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.329553] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.329747] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.329889] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.330086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20b6010b-150c-4231-8d8a-f73b6791118c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.523775] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: SUCCESS [ 1112.524379] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.524719] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.525060] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.525436] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.525723] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.525901] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.526169] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.526356] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.526533] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.526742] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.548651] env[66834]: INFO networking_nsxv3.common.synchronization [req-84794eb3-05f0-4d8a-b04b-730142e2919c req-38d6866f-af00-4711-9f43-2c9864ad8961 tempest-ServersTestJSON-861266990 tempest-ServersTestJSON-861266990-project-member] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1112.548922] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1112.549300] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.549445] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.549514] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.549711] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.549876] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.549976] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.550071] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.550237] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.550325] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.550429] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.798400] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: SUCCESS [ 1112.798768] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06251551-417e-4f8a-9412-fdb5036f57fe deletion is rescheduled due to dependency. [ 1112.798768] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.798860] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.799101] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.799285] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.799404] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.799463] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.799633] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.799723] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.799815] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.867989] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-849 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.868269] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.868468] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.868852] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.869213] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.869383] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.869500] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.869719] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.869859] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.870137] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1112.870401] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1112.870401] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1112.870507] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1112.870623] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1112.870746] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1112.870884] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1112.888137] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1112.889054] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1112.889054] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1112.889054] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.889054] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-f2ab4f90-2c88-4e92-ae34-1a8153e44c90 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.889054] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-f2ab4f90-2c88-4e92-ae34-1a8153e44c90" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.889323] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-f2ab4f90-2c88-4e92-ae34-1a8153e44c90" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.889473] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-f2ab4f90-2c88-4e92-ae34-1a8153e44c90" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.889612] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2ab4f90-2c88-4e92-ae34-1a8153e44c90',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.028860] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.029089] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.029089] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.029313] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.029481] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.029584] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.029647] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.029798] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.029887] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.029975] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.030171] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.030253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.030336] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.030463] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.030606] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.030688] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.030748] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.030882] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.030956] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.031050] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.031142] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.052538] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.303080] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.392870] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.393017] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.393059] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.393435] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.393612] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.393770] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port f2ab4f90-2c88-4e92-ae34-1a8153e44c90 not found, creating... [ 1113.394218] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.394875] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.394875] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.394875] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.394875] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.395049] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.395201] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.395310] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.395505] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.395627] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.395760] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: f2ab4f90-2c88-4e92-ae34-1a8153e44c90 is going to be created. [ 1113.415860] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.416071] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.416198] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.416455] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.416676] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.416901] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-f2ab4f90-2c88-4e92-ae34-1a8153e44c90" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.533740] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2989937c-6050-493e-a1d8-79a52d9b6132: rpc.has_security_group_logging(os_id): False [ 1113.555171] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.562692] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.562842] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.562931] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.563183] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.563291] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.563499] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.563628] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.563718] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.563850] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.563928] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.564129] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.564222] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.564269] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.564418] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.564522] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.564706] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.564802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.564849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.564986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.565074] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.565162] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2989937c-6050-493e-a1d8-79a52d9b6132 is going to be updated. [ 1113.637053] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.637053] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.637053] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.637515] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.637515] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.659541] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: IN_PROGRESS for 2s [ 1113.805072] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.057848] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.058069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.058209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.058538] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.058637] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.058746] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be updated. [ 1114.092264] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.092492] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.092492] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.092644] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.092791] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.104581] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 1114.138223] env[66834]: INFO networking_nsxv3.common.synchronization [req-84794eb3-05f0-4d8a-b04b-730142e2919c req-bb0805e4-9e45-470d-8efc-4736aa7b11ad service nova] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_rules [ 1114.138363] env[66834]: INFO networking_nsxv3.common.synchronization [req-84794eb3-05f0-4d8a-b04b-730142e2919c req-bb0805e4-9e45-470d-8efc-4736aa7b11ad service nova] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1114.138490] env[66834]: INFO networking_nsxv3.common.synchronization [req-84794eb3-05f0-4d8a-b04b-730142e2919c req-bb0805e4-9e45-470d-8efc-4736aa7b11ad service nova] Enqueued Resource ID: f2ab4f90-2c88-4e92-ae34-1a8153e44c90 with Priority: HIGHEST for action port [ 1114.139079] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_rules [ 1114.139264] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1114.139393] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2ab4f90-2c88-4e92-ae34-1a8153e44c90 with Priority: HIGHEST for action port [ 1114.139878] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.139878] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.139878] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.140569] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.140569] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.142763] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.142876] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.143547] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2ab4f90-2c88-4e92-ae34-1a8153e44c90 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.143547] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2ab4f90-2c88-4e92-ae34-1a8153e44c90" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.143547] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2ab4f90-2c88-4e92-ae34-1a8153e44c90" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.143547] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2ab4f90-2c88-4e92-ae34-1a8153e44c90" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.147163] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2ab4f90-2c88-4e92-ae34-1a8153e44c90',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.307319] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.307511] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.307613] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.307924] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.308078] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.308215] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06251551-417e-4f8a-9412-fdb5036f57fe is going to be updated. [ 1114.344574] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.344748] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.344786] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.344999] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.345164] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.355249] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: IN_PROGRESS for 2s [ 1114.642806] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.642982] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.650713] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2ab4f90-2c88-4e92-ae34-1a8153e44c90 with status ACTIVE [ 1114.650713] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.650713] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.650713] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.650911] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.650911] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.651029] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.651468] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.651553] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.651887] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.651887] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.651964] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.652928] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.652928] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.652928] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.652928] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.652928] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2ab4f90-2c88-4e92-ae34-1a8153e44c90 is going to be updated. [ 1114.674233] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.674457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.674534] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.674780] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.674947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.675138] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2ab4f90-2c88-4e92-ae34-1a8153e44c90" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.677048] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: SUCCESS [ 1115.677358] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.116691] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 1116.117014] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.117255] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.117589] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.117789] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.118118] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.118237] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.118487] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.118575] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.118712] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.369092] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: SUCCESS [ 1116.369491] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.369710] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.369969] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.370881] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.370881] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.370881] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.370881] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.370881] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.370881] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.370881] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.536267] env[66834]: INFO networking_nsxv3.common.synchronization [req-9a1157e3-6487-4ed8-aefd-874d3ee3ff2f req-35e3c278-c616-410f-8be2-385ba20f02ce tempest-ServersV294TestFqdnHostnames-945274817 tempest-ServersV294TestFqdnHostnames-945274817-project-member] Enqueued Resource ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 with Priority: HIGHEST for action security_group_members [ 1116.536822] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 with Priority: HIGHEST for action security_group_members [ 1116.537532] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d437be3-ac8e-4142-becb-dfc82235f8e5 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.537670] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.537741] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.537953] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.538127] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.538231] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.538297] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.538577] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.538577] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.538662] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d437be3-ac8e-4142-becb-dfc82235f8e5',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.621139] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.873474] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.040398] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.040566] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.040640] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.040863] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.040955] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.041159] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.041260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.041323] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.041470] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.041548] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.041635] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 is going to be updated. [ 1117.069330] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.069506] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.069542] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.069765] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.070468] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.081116] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 in Status: IN_PROGRESS for 2s [ 1117.123989] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.376252] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06251551-417e-4f8a-9412-fdb5036f57fe: rpc.has_security_group_logging(os_id): False [ 1117.402294] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.402294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.402294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.402294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.402294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.402294] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.402294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.402294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.402294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.402294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.402294] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06251551-417e-4f8a-9412-fdb5036f57fe is going to be updated. [ 1117.626052] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.626299] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.626299] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.626508] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.626602] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.626698] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be updated. [ 1117.631174] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.631174] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.631174] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.631174] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.631174] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.646387] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: IN_PROGRESS for 2s [ 1117.661799] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.661921] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.662013] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.662255] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.662439] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.675180] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 1118.492739] env[66834]: INFO networking_nsxv3.common.synchronization [req-b18aaecb-77d7-43ee-88dc-87cb113428bb req-3b2fc204-79bf-4e9c-85fe-a7502360df3d tempest-DeleteServersTestJSON-1250802255 tempest-DeleteServersTestJSON-1250802255-project-member] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 1118.493384] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGHEST for action security_group_members [ 1118.493726] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.493851] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.493915] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.494130] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.494523] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.494523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.494523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.494969] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.494969] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.494969] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.997725] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.997931] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.997931] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.998181] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.998273] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.998542] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.998646] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.998708] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.998870] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.998946] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.999047] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be updated. [ 1119.027946] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.028101] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.028169] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.028370] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.028512] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.039225] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: IN_PROGRESS for 2s [ 1119.090575] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 in Status: SUCCESS [ 1119.090757] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 deletion is rescheduled due to dependency. [ 1119.090870] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.661213] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: SUCCESS [ 1119.661213] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.689663] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 1119.689836] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.690385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.690385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.690497] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.690597] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.690662] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.691306] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.691306] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.691306] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.691306] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.194597] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.194853] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.194853] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.195635] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.195635] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.195635] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.195635] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.195635] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.195870] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.195870] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.195932] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.196061] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.196112] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.196262] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.196432] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.196511] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.196570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.196761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.196813] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.196883] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.196971] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.700729] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c88662f-4694-4988-b716-56b85d22f3c9: rpc.has_security_group_logging(os_id): False [ 1120.719398] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.719835] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.719835] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.719835] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.720110] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.720458] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.720458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.721144] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.721144] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.721144] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.721272] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.721375] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.721436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.721581] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.721658] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.721862] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.721955] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.722025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.722168] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.722720] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.722720] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be updated. [ 1120.791073] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.791073] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.791073] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.791073] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.791073] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.808469] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 1121.050673] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a15c14c6-0aee-4e9d-b481-2661c510f44a in Status: SUCCESS [ 1121.051087] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a deletion is rescheduled due to dependency. [ 1121.051087] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.826531] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 1122.826887] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.493904] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1123.494016] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1125.503786] env[66834]: INFO networking_nsxv3.common.synchronization [None req-e8e12f2d-ab02-4f80-9bf6-db716a76a3c2 None None] Enqueued Resource ID: 9fdcddf4-5f6a-421b-b131-aa9c0e22a3bc with Priority: HIGHEST for action port [ 1125.504417] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fdcddf4-5f6a-421b-b131-aa9c0e22a3bc with Priority: HIGHEST for action port [ 1125.504657] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fdcddf4-5f6a-421b-b131-aa9c0e22a3bc taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.504782] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fdcddf4-5f6a-421b-b131-aa9c0e22a3bc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.504847] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fdcddf4-5f6a-421b-b131-aa9c0e22a3bc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.506321] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fdcddf4-5f6a-421b-b131-aa9c0e22a3bc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.506321] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fdcddf4-5f6a-421b-b131-aa9c0e22a3bc',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.695140] env[66834]: INFO networking_nsxv3.common.synchronization [req-dfe190ab-179c-4031-af19-c43e356be124 req-5112023a-7b9e-4d41-9f4d-f64bfedcc9f8 tempest-ServerActionsTestOtherA-283121819 tempest-ServerActionsTestOtherA-283121819-project-member] Enqueued Resource ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d with Priority: HIGHEST for action security_group_members [ 1125.695140] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d with Priority: HIGHEST for action security_group_members [ 1125.695140] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-0750b6a7-8358-4db0-b46f-3ccbf925625d taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.695140] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.695140] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.695140] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.695140] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.696365] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.696502] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.696828] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.696828] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.696828] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0750b6a7-8358-4db0-b46f-3ccbf925625d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.012183] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9fdcddf4-5f6a-421b-b131-aa9c0e22a3bc [ 1126.012600] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.014101] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.014101] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.014101] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.014101] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.014101] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9fdcddf4-5f6a-421b-b131-aa9c0e22a3bc already deleted. [ 1126.014101] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fdcddf4-5f6a-421b-b131-aa9c0e22a3bc" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.199927] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.200973] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.200973] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.201203] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.223902] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.224218] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.224362] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.224431] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.224654] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.224733] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.224836] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d is going to be updated. [ 1126.256438] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.256438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.256687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.256731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.256895] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.268094] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d in Status: IN_PROGRESS for 2s [ 1126.426907] env[66834]: INFO networking_nsxv3.common.synchronization [req-5b03f0ce-c121-4cf0-b2f2-9125d27707d0 req-0f41f0f4-c6de-421b-ba97-48e4824b2794 tempest-AttachInterfacesTestJSON-77868371 tempest-AttachInterfacesTestJSON-77868371-project-member] Enqueued Resource ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 with Priority: HIGHEST for action security_group_members [ 1126.428147] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 with Priority: HIGHEST for action security_group_members [ 1126.428922] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.429189] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.429335] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.429605] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.429858] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.430077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.430218] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.430465] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.430633] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.430880] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac8e3a64-d540-43bb-a864-6d42bf3a44c4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.714505] env[66834]: INFO networking_nsxv3.common.synchronization [req-94d3700d-7aa8-49d7-a9d4-7e91699e68e8 req-36a8dec7-e737-4bbf-82d8-50e149a9e174 tempest-ServersTestJSON-861266990 tempest-ServersTestJSON-861266990-project-member] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1126.715365] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1126.717165] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.717165] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.717165] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.717165] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.717458] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.717505] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.717548] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.717729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.717824] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.717922] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.934258] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac8e3a64-d540-43bb-a864-6d42bf3a44c4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.221869] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.437498] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac8e3a64-d540-43bb-a864-6d42bf3a44c4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.726338] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.901662] env[66834]: INFO networking_nsxv3.common.synchronization [None req-a4ae4e01-91ef-41a6-a67e-a9ad2d70c76e None None] Enqueued Resource ID: 3249fd1c-a298-4b76-907b-e335a897e616 with Priority: HIGHEST for action port [ 1127.902283] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3249fd1c-a298-4b76-907b-e335a897e616 with Priority: HIGHEST for action port [ 1127.902701] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-3249fd1c-a298-4b76-907b-e335a897e616 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.902838] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3249fd1c-a298-4b76-907b-e335a897e616" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.902939] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3249fd1c-a298-4b76-907b-e335a897e616" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.905820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3249fd1c-a298-4b76-907b-e335a897e616" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.905820] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3249fd1c-a298-4b76-907b-e335a897e616',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.940868] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.941120] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.941222] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.941522] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.941649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.941805] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 is going to be updated. [ 1127.976297] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.976464] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.976520] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.976721] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.976865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.986893] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 in Status: IN_PROGRESS for 2s [ 1128.229624] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.229793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.229972] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.230271] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.230271] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.230552] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be updated. [ 1128.265111] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.265284] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.265321] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.265538] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.265679] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.276383] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 1128.277089] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d in Status: SUCCESS [ 1128.277253] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d deletion is rescheduled due to dependency. [ 1128.277539] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.408885] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3249fd1c-a298-4b76-907b-e335a897e616 [ 1128.409155] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.409289] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.409372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.409657] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.410244] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.410244] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3249fd1c-a298-4b76-907b-e335a897e616 already deleted. [ 1128.410244] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3249fd1c-a298-4b76-907b-e335a897e616" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.283754] env[66834]: INFO networking_nsxv3.common.synchronization [None req-859911ee-1393-479b-a497-616aa2cdab1b None None] Enqueued Resource ID: 0b386994-2b05-499c-b59f-34f50cb4ef98 with Priority: HIGHEST for action port [ 1129.284016] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b386994-2b05-499c-b59f-34f50cb4ef98 with Priority: HIGHEST for action port [ 1129.284215] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b386994-2b05-499c-b59f-34f50cb4ef98 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.284843] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b386994-2b05-499c-b59f-34f50cb4ef98" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.284932] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b386994-2b05-499c-b59f-34f50cb4ef98" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.285429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b386994-2b05-499c-b59f-34f50cb4ef98" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.285429] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b386994-2b05-499c-b59f-34f50cb4ef98',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.787451] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b386994-2b05-499c-b59f-34f50cb4ef98 [ 1129.787659] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.787795] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.787865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.788151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.788187] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.788273] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b386994-2b05-499c-b59f-34f50cb4ef98 already deleted. [ 1129.788354] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b386994-2b05-499c-b59f-34f50cb4ef98" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.998820] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 in Status: SUCCESS [ 1129.998820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.289404] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 1130.291725] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.740409] env[66834]: INFO networking_nsxv3.common.synchronization [None req-da593c6a-8347-4ceb-a1e3-b0553fc2a4b1 None None] Enqueued Resource ID: cb1c5024-2c52-4213-a4a1-a23b4f8c6aeb with Priority: HIGHEST for action port [ 1131.740758] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1c5024-2c52-4213-a4a1-a23b4f8c6aeb with Priority: HIGHEST for action port [ 1131.741318] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb1c5024-2c52-4213-a4a1-a23b4f8c6aeb taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.741437] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb1c5024-2c52-4213-a4a1-a23b4f8c6aeb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.741504] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb1c5024-2c52-4213-a4a1-a23b4f8c6aeb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.741852] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb1c5024-2c52-4213-a4a1-a23b4f8c6aeb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.741852] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb1c5024-2c52-4213-a4a1-a23b4f8c6aeb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.245090] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb1c5024-2c52-4213-a4a1-a23b4f8c6aeb [ 1132.245090] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.245378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.245378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.245495] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.246103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.246103] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb1c5024-2c52-4213-a4a1-a23b4f8c6aeb already deleted. [ 1132.246103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb1c5024-2c52-4213-a4a1-a23b4f8c6aeb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.986994] env[66834]: INFO networking_nsxv3.common.synchronization [req-c4bc660c-ff5b-4b37-96e5-9d61eb0ada97 req-841a9c31-47bf-4d3a-b562-38724dad704a tempest-AttachInterfacesTestJSON-77868371 tempest-AttachInterfacesTestJSON-77868371-project-member] Enqueued Resource ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 with Priority: HIGHEST for action security_group_members [ 1134.987959] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 with Priority: HIGHEST for action security_group_members [ 1134.987959] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.988106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.988106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.988239] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.988771] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.988881] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.988945] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.989123] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.989212] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.989305] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac8e3a64-d540-43bb-a864-6d42bf3a44c4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.491720] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.491939] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.492032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.493645] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.493645] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.493645] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.493645] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.493645] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.493645] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.493645] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.493645] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 is going to be updated. [ 1135.538463] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.538607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.538671] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.538881] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.539028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.547480] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 in Status: IN_PROGRESS for 2s [ 1136.301825] env[66834]: INFO networking_nsxv3.common.synchronization [req-39d48079-fa6c-465c-ae15-e75a827feb6e req-a2ab46b5-fb2d-4a29-a926-1091c5d9db01 tempest-ServerRescueTestJSON-244035781 tempest-ServerRescueTestJSON-244035781-project-member] Enqueued Resource ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b with Priority: HIGHEST for action security_group_members [ 1136.302383] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b with Priority: HIGHEST for action security_group_members [ 1136.302743] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf09a47e-d4ed-48d3-bd2e-95954524a76b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.302857] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.302951] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.303347] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.303510] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.303631] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.303690] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.303812] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.303894] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.303986] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf09a47e-d4ed-48d3-bd2e-95954524a76b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.654013] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-280 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.654210] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-280" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.654332] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-280" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.654654] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-280" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.655474] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.655474] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.655474] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.655474] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.655703] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.655737] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1136.655822] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1136.655927] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1136.656042] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1136.656148] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1136.656248] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1136.656371] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1136.676030] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1136.676030] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1136.676030] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1136.676030] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-280" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.676264] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-f6ee4cb7-472c-4788-80a5-1b7e94acf6a7 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.676344] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-f6ee4cb7-472c-4788-80a5-1b7e94acf6a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.676393] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-f6ee4cb7-472c-4788-80a5-1b7e94acf6a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.676889] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-f6ee4cb7-472c-4788-80a5-1b7e94acf6a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.677050] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6ee4cb7-472c-4788-80a5-1b7e94acf6a7',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.806239] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.806412] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.806465] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.806698] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.806789] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.806981] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.807093] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.807150] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.807302] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.807375] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.807525] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b already deleted. [ 1136.807625] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.179876] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.180125] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.180281] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.180674] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.180830] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.180987] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port f6ee4cb7-472c-4788-80a5-1b7e94acf6a7 not found, creating... [ 1137.181263] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.181420] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.181537] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.181747] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.181882] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.182239] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.182472] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.183399] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.183839] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.183977] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.184132] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: f6ee4cb7-472c-4788-80a5-1b7e94acf6a7 is going to be created. [ 1137.208359] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.208575] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.208686] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.208940] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.209189] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.209404] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-f6ee4cb7-472c-4788-80a5-1b7e94acf6a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.557960] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 in Status: SUCCESS [ 1137.558357] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 deletion is rescheduled due to dependency. [ 1137.558357] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.942144] env[66834]: INFO networking_nsxv3.common.synchronization [req-39d48079-fa6c-465c-ae15-e75a827feb6e req-81243368-b86a-430f-aede-de234f5c5bc1 service nova] Enqueued Resource ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b with Priority: HIGHEST for action security_group_rules [ 1137.942347] env[66834]: INFO networking_nsxv3.common.synchronization [req-39d48079-fa6c-465c-ae15-e75a827feb6e req-81243368-b86a-430f-aede-de234f5c5bc1 service nova] Enqueued Resource ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b with Priority: HIGHEST for action security_group_members [ 1137.942543] env[66834]: INFO networking_nsxv3.common.synchronization [req-39d48079-fa6c-465c-ae15-e75a827feb6e req-81243368-b86a-430f-aede-de234f5c5bc1 service nova] Enqueued Resource ID: f6ee4cb7-472c-4788-80a5-1b7e94acf6a7 with Priority: HIGHEST for action port [ 1137.943578] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b with Priority: HIGHEST for action security_group_rules [ 1137.943738] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b with Priority: HIGHEST for action security_group_members [ 1137.943852] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6ee4cb7-472c-4788-80a5-1b7e94acf6a7 with Priority: HIGHEST for action port [ 1137.944209] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf09a47e-d4ed-48d3-bd2e-95954524a76b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.944355] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.944455] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.945558] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.945558] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf09a47e-d4ed-48d3-bd2e-95954524a76b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.948044] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf09a47e-d4ed-48d3-bd2e-95954524a76b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.948044] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.948044] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.948044] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.948044] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.948044] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.948044] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.948044] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.948044] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.948044] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf09a47e-d4ed-48d3-bd2e-95954524a76b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.948529] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6ee4cb7-472c-4788-80a5-1b7e94acf6a7 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.948529] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6ee4cb7-472c-4788-80a5-1b7e94acf6a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.948620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6ee4cb7-472c-4788-80a5-1b7e94acf6a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.948752] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6ee4cb7-472c-4788-80a5-1b7e94acf6a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.948828] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6ee4cb7-472c-4788-80a5-1b7e94acf6a7',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.448720] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf09a47e-d4ed-48d3-bd2e-95954524a76b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.448865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.454057] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf09a47e-d4ed-48d3-bd2e-95954524a76b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.454551] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f6ee4cb7-472c-4788-80a5-1b7e94acf6a7 with status ACTIVE [ 1138.455973] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.456148] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.456307] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.456430] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.456519] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.456701] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.456800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.456861] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.457012] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.457092] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.457287] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.457382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.457441] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.458343] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.458510] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.458615] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f6ee4cb7-472c-4788-80a5-1b7e94acf6a7 is going to be updated. [ 1138.481271] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.481445] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.481503] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.481678] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.481811] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.481962] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6ee4cb7-472c-4788-80a5-1b7e94acf6a7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.552580] env[66834]: INFO networking_nsxv3.common.synchronization [req-2ff40406-dc48-4f94-b76f-a54895b9478a req-b0233ad5-ead1-4635-8165-b92c8e5dcb32 tempest-ServerRescueNegativeTestJSON-599514552 tempest-ServerRescueNegativeTestJSON-599514552-project-member] Enqueued Resource ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 with Priority: HIGHEST for action security_group_members [ 1138.553151] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 with Priority: HIGHEST for action security_group_members [ 1138.553474] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-52cb0804-8dc9-431c-b223-368ab8a8eb18 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.553561] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.553613] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.553857] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.554278] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.554278] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.554278] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.554450] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.554523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.554628] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52cb0804-8dc9-431c-b223-368ab8a8eb18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.885105] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-287 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.885431] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-287" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.885431] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-287" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.885757] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-287" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.886170] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.886375] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.886494] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.886738] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.886882] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.887712] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1138.887712] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1138.887712] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1138.887712] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1138.887712] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1138.887712] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1138.887712] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1138.906336] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1138.906492] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1138.906628] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1138.906863] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-287" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.907200] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-9d799fdb-4b2b-426d-90ae-fc59709e65c3 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.907373] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-9d799fdb-4b2b-426d-90ae-fc59709e65c3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.907490] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-9d799fdb-4b2b-426d-90ae-fc59709e65c3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.907811] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-9d799fdb-4b2b-426d-90ae-fc59709e65c3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.907947] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d799fdb-4b2b-426d-90ae-fc59709e65c3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.960962] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf09a47e-d4ed-48d3-bd2e-95954524a76b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.058055] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.058055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.058055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.058055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.058055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.058055] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.058055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.058055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.058055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.058055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.058055] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 already deleted. [ 1139.058055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.411547] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.411547] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.411547] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.411547] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.411842] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.411842] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 9d799fdb-4b2b-426d-90ae-fc59709e65c3 not found, creating... [ 1139.412043] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.412143] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.412247] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.412574] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.412621] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.412877] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.413039] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.413165] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.413348] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.413491] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.413679] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 9d799fdb-4b2b-426d-90ae-fc59709e65c3 is going to be created. [ 1139.433345] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.433567] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.433687] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.433949] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.434196] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.434409] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-9d799fdb-4b2b-426d-90ae-fc59709e65c3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.464458] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.464756] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.464756] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.464926] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.464974] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.465051] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b is going to be created. [ 1139.513911] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.514094] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.514169] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.514399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.514565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.529681] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b in Status: UNINITIALIZED for 2s [ 1140.978223] env[66834]: INFO networking_nsxv3.common.synchronization [req-2ff40406-dc48-4f94-b76f-a54895b9478a req-2d9d8ae5-5756-40a7-98cc-367b35cdd207 service nova] Enqueued Resource ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 with Priority: HIGHEST for action security_group_rules [ 1140.978504] env[66834]: INFO networking_nsxv3.common.synchronization [req-2ff40406-dc48-4f94-b76f-a54895b9478a req-2d9d8ae5-5756-40a7-98cc-367b35cdd207 service nova] Enqueued Resource ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 with Priority: HIGHEST for action security_group_members [ 1140.978583] env[66834]: INFO networking_nsxv3.common.synchronization [req-2ff40406-dc48-4f94-b76f-a54895b9478a req-2d9d8ae5-5756-40a7-98cc-367b35cdd207 service nova] Enqueued Resource ID: 9d799fdb-4b2b-426d-90ae-fc59709e65c3 with Priority: HIGHEST for action port [ 1140.979298] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 with Priority: HIGHEST for action security_group_rules [ 1140.979298] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 with Priority: HIGHEST for action security_group_members [ 1140.979564] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d799fdb-4b2b-426d-90ae-fc59709e65c3 with Priority: HIGHEST for action port [ 1140.979636] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52cb0804-8dc9-431c-b223-368ab8a8eb18 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.979750] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.979891] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.980492] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.980492] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52cb0804-8dc9-431c-b223-368ab8a8eb18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.981058] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-52cb0804-8dc9-431c-b223-368ab8a8eb18 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.981152] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.981208] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.981662] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.981662] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.981781] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.981825] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.981990] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.982090] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.982234] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52cb0804-8dc9-431c-b223-368ab8a8eb18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.982972] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d799fdb-4b2b-426d-90ae-fc59709e65c3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.983605] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d799fdb-4b2b-426d-90ae-fc59709e65c3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.983605] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d799fdb-4b2b-426d-90ae-fc59709e65c3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.983605] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d799fdb-4b2b-426d-90ae-fc59709e65c3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.984407] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d799fdb-4b2b-426d-90ae-fc59709e65c3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.004272] env[66834]: INFO networking_nsxv3.common.synchronization [req-7ab6485f-2f29-439b-94db-24e93d7e5f00 req-06ce6c86-c43e-4650-8bc1-62fea9d35783 tempest-ServerRescueNegativeTestJSON-599514552 tempest-ServerRescueNegativeTestJSON-599514552-project-member] Enqueued Resource ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 with Priority: HIGHEST for action security_group_members [ 1141.004272] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 with Priority: HIGHEST for action security_group_members [ 1141.004272] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-52cb0804-8dc9-431c-b223-368ab8a8eb18 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.004272] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.365147] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-287 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.365877] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-287" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.365877] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-287" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.366243] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-287" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.366715] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.367019] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.367162] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.367977] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.367977] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.367977] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1141.367977] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1141.368161] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1141.368309] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1141.368367] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1141.368542] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1141.368756] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1141.388254] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1141.388492] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1141.388679] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1141.388761] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-287" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.389044] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-fdd0793c-4ca0-4e9b-8808-9b69c26e48f9 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.389227] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-fdd0793c-4ca0-4e9b-8808-9b69c26e48f9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.389345] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-fdd0793c-4ca0-4e9b-8808-9b69c26e48f9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.389807] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-fdd0793c-4ca0-4e9b-8808-9b69c26e48f9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.389985] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdd0793c-4ca0-4e9b-8808-9b69c26e48f9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.487193] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52cb0804-8dc9-431c-b223-368ab8a8eb18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.488288] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-52cb0804-8dc9-431c-b223-368ab8a8eb18 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.488387] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.488783] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d799fdb-4b2b-426d-90ae-fc59709e65c3 with status ACTIVE [ 1141.488945] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.489071] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.489137] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.489343] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.489428] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.489588] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.489682] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.489743] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.489899] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.489973] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.490193] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.490287] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.490387] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.490480] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.490606] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.490690] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d799fdb-4b2b-426d-90ae-fc59709e65c3 is going to be updated. [ 1141.513889] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.514079] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.514123] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.514294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.514429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.514585] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d799fdb-4b2b-426d-90ae-fc59709e65c3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.540175] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b in Status: SUCCESS [ 1141.541236] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.541236] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.541236] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.541236] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.541552] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.541552] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.541552] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.541639] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.541727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.541757] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf09a47e-d4ed-48d3-bd2e-95954524a76b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.892421] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.892705] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.892834] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.893190] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.893458] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.893638] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port fdd0793c-4ca0-4e9b-8808-9b69c26e48f9 not found, creating... [ 1141.893900] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.894097] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.894237] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.894470] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.894606] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.894894] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.895068] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.895189] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.895398] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.895531] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.895666] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: fdd0793c-4ca0-4e9b-8808-9b69c26e48f9 is going to be created. [ 1141.920551] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.920840] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.920964] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.921248] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.921478] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.921703] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-fdd0793c-4ca0-4e9b-8808-9b69c26e48f9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.989353] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52cb0804-8dc9-431c-b223-368ab8a8eb18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.044300] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf09a47e-d4ed-48d3-bd2e-95954524a76b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.044523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.044523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.044667] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.044858] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.044955] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.045063] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.045212] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.045337] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.045421] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.045559] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf09a47e-d4ed-48d3-bd2e-95954524a76b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.045676] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.045729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.045885] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.046034] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.046126] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.046185] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.046387] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.046387] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.046472] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.046556] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf09a47e-d4ed-48d3-bd2e-95954524a76b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.492124] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.492124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.492124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.492369] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.492369] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.492445] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 is going to be created. [ 1142.520363] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.520600] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.520656] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.520849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.520992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.535736] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 in Status: UNINITIALIZED for 2s [ 1142.548265] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf09a47e-d4ed-48d3-bd2e-95954524a76b: rpc.has_security_group_logging(os_id): False [ 1142.568488] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.568642] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.568711] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.568930] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.569030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.569226] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.569370] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.569370] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.569528] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.569660] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.569832] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.569929] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.569997] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.570169] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.570199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.570389] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.570484] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.570625] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.570763] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.570836] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.570919] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b is going to be created. [ 1142.632421] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.632670] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.632764] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.633025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.633243] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.644466] env[66834]: INFO networking_nsxv3.common.synchronization [req-7ab6485f-2f29-439b-94db-24e93d7e5f00 req-53072418-071b-4d42-8c98-eeb9a0cee6fb service nova] Enqueued Resource ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 with Priority: HIGHEST for action security_group_rules [ 1142.644466] env[66834]: INFO networking_nsxv3.common.synchronization [req-7ab6485f-2f29-439b-94db-24e93d7e5f00 req-53072418-071b-4d42-8c98-eeb9a0cee6fb service nova] Enqueued Resource ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 with Priority: HIGHEST for action security_group_members [ 1142.644466] env[66834]: INFO networking_nsxv3.common.synchronization [req-7ab6485f-2f29-439b-94db-24e93d7e5f00 req-53072418-071b-4d42-8c98-eeb9a0cee6fb service nova] Enqueued Resource ID: fdd0793c-4ca0-4e9b-8808-9b69c26e48f9 with Priority: HIGHEST for action port [ 1142.645328] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b in Status: IN_PROGRESS for 2s [ 1142.645785] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 with Priority: HIGHEST for action security_group_rules [ 1142.645918] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 with Priority: HIGHEST for action security_group_members [ 1142.646033] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdd0793c-4ca0-4e9b-8808-9b69c26e48f9 with Priority: HIGHEST for action port [ 1142.646333] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52cb0804-8dc9-431c-b223-368ab8a8eb18 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.646432] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.646620] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-52cb0804-8dc9-431c-b223-368ab8a8eb18 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.646702] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.646892] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-fdd0793c-4ca0-4e9b-8808-9b69c26e48f9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.646994] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fdd0793c-4ca0-4e9b-8808-9b69c26e48f9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.647068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fdd0793c-4ca0-4e9b-8808-9b69c26e48f9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.647263] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fdd0793c-4ca0-4e9b-8808-9b69c26e48f9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.647337] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdd0793c-4ca0-4e9b-8808-9b69c26e48f9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.150589] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fdd0793c-4ca0-4e9b-8808-9b69c26e48f9 with status ACTIVE [ 1143.150901] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.150987] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.151039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.151244] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.151334] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.151515] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.151615] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.151666] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.151844] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.151911] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.152107] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.152195] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.152253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.152389] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.152461] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.152668] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fdd0793c-4ca0-4e9b-8808-9b69c26e48f9 is going to be updated. [ 1143.175948] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.176186] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.176289] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.176505] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.176650] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.176810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fdd0793c-4ca0-4e9b-8808-9b69c26e48f9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.200200] env[66834]: INFO networking_nsxv3.common.synchronization [req-502b920a-7e01-4228-8386-f98f8403c83a req-56cf4bfc-0bbe-4ca5-8e26-6adb47e64faf tempest-ServerActionsTestOtherA-283121819 tempest-ServerActionsTestOtherA-283121819-project-member] Enqueued Resource ID: 673eef00-b174-4a71-a870-466f27b577fd with Priority: HIGHEST for action security_group_members [ 1143.200621] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 673eef00-b174-4a71-a870-466f27b577fd with Priority: HIGHEST for action security_group_members [ 1143.200928] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-673eef00-b174-4a71-a870-466f27b577fd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.201061] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.201126] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.201318] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.201488] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.201565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.201617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.201786] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.201872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.201973] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('673eef00-b174-4a71-a870-466f27b577fd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.544621] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.544828] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-590" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.544957] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-590" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.545281] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-590" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.545582] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.545742] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.545881] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.546192] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.546256] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.546514] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1143.546668] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1143.546801] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1143.546913] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1143.547032] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1143.547163] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1143.547295] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1143.567650] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1143.567816] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1143.567971] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1143.568143] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-590" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.568455] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-968a2662-dc05-4a49-8014-9474b9df4204 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.568628] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-968a2662-dc05-4a49-8014-9474b9df4204" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.568747] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-968a2662-dc05-4a49-8014-9474b9df4204" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.569101] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-968a2662-dc05-4a49-8014-9474b9df4204" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.569295] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('968a2662-dc05-4a49-8014-9474b9df4204',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.705050] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.705050] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.705050] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.705363] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.746337] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.746560] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.746560] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.746560] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.746868] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.746920] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.747027] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 673eef00-b174-4a71-a870-466f27b577fd is going to be updated. [ 1143.777223] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.777411] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.777513] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.778469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.778469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.793864] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 673eef00-b174-4a71-a870-466f27b577fd in Status: IN_PROGRESS for 2s [ 1144.071536] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.071823] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.072039] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.072454] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.072681] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.073385] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 968a2662-dc05-4a49-8014-9474b9df4204 not found, creating... [ 1144.073385] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.073385] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.074051] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.074051] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.074051] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.074292] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.074515] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.074737] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.074971] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.075123] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.075262] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 968a2662-dc05-4a49-8014-9474b9df4204 is going to be created. [ 1144.097812] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.098041] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.098111] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.098378] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.098607] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.098836] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-968a2662-dc05-4a49-8014-9474b9df4204" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.557021] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 in Status: SUCCESS [ 1144.557294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.557599] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.557787] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.557990] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.558152] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.558197] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.558391] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.558422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.559073] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52cb0804-8dc9-431c-b223-368ab8a8eb18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.658275] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b in Status: SUCCESS [ 1144.658902] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.814478] env[66834]: INFO networking_nsxv3.common.synchronization [req-502b920a-7e01-4228-8386-f98f8403c83a req-a598c460-6c87-4fa2-a101-a88cd6cf2ba8 service nova] Enqueued Resource ID: 673eef00-b174-4a71-a870-466f27b577fd with Priority: HIGHEST for action security_group_rules [ 1144.814478] env[66834]: INFO networking_nsxv3.common.synchronization [req-502b920a-7e01-4228-8386-f98f8403c83a req-a598c460-6c87-4fa2-a101-a88cd6cf2ba8 service nova] Enqueued Resource ID: 673eef00-b174-4a71-a870-466f27b577fd with Priority: HIGHEST for action security_group_members [ 1144.814478] env[66834]: INFO networking_nsxv3.common.synchronization [req-502b920a-7e01-4228-8386-f98f8403c83a req-a598c460-6c87-4fa2-a101-a88cd6cf2ba8 service nova] Enqueued Resource ID: 968a2662-dc05-4a49-8014-9474b9df4204 with Priority: HIGHEST for action port [ 1144.814478] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 673eef00-b174-4a71-a870-466f27b577fd with Priority: HIGHEST for action security_group_rules [ 1144.814478] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 673eef00-b174-4a71-a870-466f27b577fd with Priority: HIGHEST for action security_group_members [ 1144.814478] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 968a2662-dc05-4a49-8014-9474b9df4204 with Priority: HIGHEST for action port [ 1144.814879] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-673eef00-b174-4a71-a870-466f27b577fd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.815068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.815174] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.815472] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.816391] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('673eef00-b174-4a71-a870-466f27b577fd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.817650] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-673eef00-b174-4a71-a870-466f27b577fd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.818067] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.818375] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-968a2662-dc05-4a49-8014-9474b9df4204 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.818612] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-968a2662-dc05-4a49-8014-9474b9df4204" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.818755] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-968a2662-dc05-4a49-8014-9474b9df4204" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.819022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-968a2662-dc05-4a49-8014-9474b9df4204" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.820383] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('968a2662-dc05-4a49-8014-9474b9df4204',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.061614] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52cb0804-8dc9-431c-b223-368ab8a8eb18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.321546] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-673eef00-b174-4a71-a870-466f27b577fd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.321760] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.321917] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 968a2662-dc05-4a49-8014-9474b9df4204 with status ACTIVE [ 1145.321988] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.322120] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.322186] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.322408] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.322766] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.322766] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.322947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.322947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.323077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.323157] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.323336] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.323429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.323487] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.323687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.323770] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.323856] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 968a2662-dc05-4a49-8014-9474b9df4204 is going to be updated. [ 1145.346893] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.347132] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.347247] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.347541] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.347756] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.348014] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-968a2662-dc05-4a49-8014-9474b9df4204" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.564152] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52cb0804-8dc9-431c-b223-368ab8a8eb18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.806214] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 673eef00-b174-4a71-a870-466f27b577fd in Status: SUCCESS [ 1145.806400] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 673eef00-b174-4a71-a870-466f27b577fd deletion is rescheduled due to dependency. [ 1145.806526] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.806717] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.806941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.807259] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.807364] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.807364] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.807495] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.807571] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.807664] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('673eef00-b174-4a71-a870-466f27b577fd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.067874] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.068054] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.068111] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.068337] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.068427] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.068527] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 is going to be updated. [ 1146.094234] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.094433] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.094433] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.094619] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.094766] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.102942] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 in Status: IN_PROGRESS for 2s [ 1146.311076] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('673eef00-b174-4a71-a870-466f27b577fd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.812203] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('673eef00-b174-4a71-a870-466f27b577fd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.314676] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.314941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.315089] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.315411] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.315580] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.315765] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 673eef00-b174-4a71-a870-466f27b577fd is going to be updated. [ 1147.354167] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.354332] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.354404] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.354688] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.354905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.369302] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 673eef00-b174-4a71-a870-466f27b577fd in Status: IN_PROGRESS for 2s [ 1148.115434] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 in Status: SUCCESS [ 1148.115434] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.115937] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.115937] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.116052] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.116132] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.116182] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.116463] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.116550] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.116689] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.116744] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52cb0804-8dc9-431c-b223-368ab8a8eb18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.117709] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.117904] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.118100] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.118421] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.118421] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.118518] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.118518] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.118633] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52cb0804-8dc9-431c-b223-368ab8a8eb18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.454019] env[66834]: INFO networking_nsxv3.common.synchronization [req-d78db072-ec86-4de4-845b-a5c4c53f43a7 req-6f722903-170d-4ec8-b469-3aea6652cc7a tempest-ServersTestJSON-861266990 tempest-ServersTestJSON-861266990-project-member] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1148.454553] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1148.454866] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.455668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.455668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.455668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.455668] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.455668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.455668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.455930] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.455930] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.456377] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.620418] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-52cb0804-8dc9-431c-b223-368ab8a8eb18 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.620610] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.620835] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52cb0804-8dc9-431c-b223-368ab8a8eb18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.788665] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-849 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.788970] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.789204] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.789565] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.789942] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.790203] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.790399] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.790699] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.790857] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.791090] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1148.791213] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1148.791337] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1148.791499] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1148.791615] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1148.791756] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1148.791929] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1148.813402] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1148.813645] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1148.813844] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1148.814114] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-849" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.814504] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-c63e579c-0230-4aab-9c51-179a6175e9f9 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.814736] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-c63e579c-0230-4aab-9c51-179a6175e9f9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.814925] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-c63e579c-0230-4aab-9c51-179a6175e9f9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.816051] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-c63e579c-0230-4aab-9c51-179a6175e9f9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.816051] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c63e579c-0230-4aab-9c51-179a6175e9f9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.959838] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.122800] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52cb0804-8dc9-431c-b223-368ab8a8eb18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.318585] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.318926] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.319086] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.319548] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.319770] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.320015] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port c63e579c-0230-4aab-9c51-179a6175e9f9 not found, creating... [ 1149.320418] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.320666] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.320817] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.321256] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.321503] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.321958] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.322244] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.322392] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.322667] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.322836] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.323089] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: c63e579c-0230-4aab-9c51-179a6175e9f9 is going to be created. [ 1149.347963] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.348217] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.348354] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.348624] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.348887] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.349129] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-c63e579c-0230-4aab-9c51-179a6175e9f9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.387966] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 673eef00-b174-4a71-a870-466f27b577fd in Status: SUCCESS [ 1149.389039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.389039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.389039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.389319] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.389319] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.389454] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.389624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.389748] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.389880] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.390028] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('673eef00-b174-4a71-a870-466f27b577fd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.463069] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.628252] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.628428] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.628504] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.628738] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.628833] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.629307] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 is going to be updated. [ 1149.663422] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.663618] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.663714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.663865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.664057] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.675403] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 in Status: IN_PROGRESS for 2s [ 1149.894805] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-673eef00-b174-4a71-a870-466f27b577fd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.895085] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.895203] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.895538] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.895799] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.895936] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.896090] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.896342] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.896474] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.896613] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.896863] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-673eef00-b174-4a71-a870-466f27b577fd taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.896996] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.897135] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.897346] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.897569] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.897713] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.897825] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.898043] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.898180] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.898310] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.898440] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('673eef00-b174-4a71-a870-466f27b577fd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.965796] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.965973] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.966053] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.966309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.966456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.966532] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be updated. [ 1149.999236] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.999236] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.999236] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.999438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.999591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.009688] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 1150.069852] env[66834]: INFO networking_nsxv3.common.synchronization [req-d78db072-ec86-4de4-845b-a5c4c53f43a7 req-2ac60ec7-c502-4fc4-bea7-b0b087dfc597 service nova] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_rules [ 1150.070257] env[66834]: INFO networking_nsxv3.common.synchronization [req-d78db072-ec86-4de4-845b-a5c4c53f43a7 req-2ac60ec7-c502-4fc4-bea7-b0b087dfc597 service nova] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1150.070529] env[66834]: INFO networking_nsxv3.common.synchronization [req-d78db072-ec86-4de4-845b-a5c4c53f43a7 req-2ac60ec7-c502-4fc4-bea7-b0b087dfc597 service nova] Enqueued Resource ID: c63e579c-0230-4aab-9c51-179a6175e9f9 with Priority: HIGHEST for action port [ 1150.071175] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_rules [ 1150.071388] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1150.071526] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c63e579c-0230-4aab-9c51-179a6175e9f9 with Priority: HIGHEST for action port [ 1150.071885] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.072060] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.072166] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.072378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.072502] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.074148] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.074295] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.074973] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-c63e579c-0230-4aab-9c51-179a6175e9f9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.075152] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c63e579c-0230-4aab-9c51-179a6175e9f9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.075283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c63e579c-0230-4aab-9c51-179a6175e9f9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.075716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c63e579c-0230-4aab-9c51-179a6175e9f9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.076114] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c63e579c-0230-4aab-9c51-179a6175e9f9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.401870] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 673eef00-b174-4a71-a870-466f27b577fd: rpc.has_security_group_logging(os_id): False [ 1150.423101] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.423101] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.423101] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.423392] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.423469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.423742] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.423902] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.423975] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.424222] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.424542] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.424619] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.425690] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.425690] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.425690] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.425690] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.425690] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.425690] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.425690] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.425986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.425986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.425986] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 673eef00-b174-4a71-a870-466f27b577fd is going to be updated. [ 1150.461897] env[66834]: INFO networking_nsxv3.common.synchronization [None req-ca0a9078-b2b8-4463-9dc7-5cc9d85b4ec1 tempest-AttachInterfacesTestJSON-77868371 tempest-AttachInterfacesTestJSON-77868371-project-member] Enqueued Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 1150.462511] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGHEST for action security_group_members [ 1150.462873] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.462990] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.463073] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.463303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.463457] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.463582] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.463650] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.464598] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.464598] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.464598] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.493593] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.493897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.494066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.494326] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.494521] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.510518] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 673eef00-b174-4a71-a870-466f27b577fd in Status: IN_PROGRESS for 2s [ 1150.578430] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.578719] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.579597] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c63e579c-0230-4aab-9c51-179a6175e9f9 with status ACTIVE [ 1150.580086] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.580554] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.580554] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.580955] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.581140] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.581471] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.581622] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.581738] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.581993] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.582184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.582536] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.582755] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.582868] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.583146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.583264] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.584380] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c63e579c-0230-4aab-9c51-179a6175e9f9 is going to be updated. [ 1150.624586] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.624586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.624586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.624941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.624941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.625165] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c63e579c-0230-4aab-9c51-179a6175e9f9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.966521] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.966791] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.966906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.967276] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.967456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.967771] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.967949] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.968061] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.968305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.968429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.968576] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2989937c-6050-493e-a1d8-79a52d9b6132 is going to be updated. [ 1151.003505] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.003781] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.003831] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.004096] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.004268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.017295] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: IN_PROGRESS for 2s [ 1151.688139] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 in Status: SUCCESS [ 1151.688139] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.688139] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.688621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.688681] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.688853] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.688943] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.689137] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.689283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.689379] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.689606] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-52cb0804-8dc9-431c-b223-368ab8a8eb18 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.689726] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.689786] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.689967] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.690412] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.690412] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.690412] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.690412] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.690628] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.690628] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.690751] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52cb0804-8dc9-431c-b223-368ab8a8eb18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.024058] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 1152.024058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.024058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.024058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.024058] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.024058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.024747] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.024747] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.024747] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.024747] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.193388] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52cb0804-8dc9-431c-b223-368ab8a8eb18: rpc.has_security_group_logging(os_id): False [ 1152.213650] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.213914] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.214018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.214172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.214271] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.214484] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.214597] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.214655] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.214826] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.214940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.215120] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.215221] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.215277] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.215438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.215501] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.215720] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.215813] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.215886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.216011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.216229] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.216319] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 is going to be created. [ 1152.287600] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.287837] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.287837] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.288095] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.288290] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.303662] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 in Status: IN_PROGRESS for 2s [ 1152.526929] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.532142] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 673eef00-b174-4a71-a870-466f27b577fd in Status: SUCCESS [ 1152.532364] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.029055] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989937c-6050-493e-a1d8-79a52d9b6132 in Status: SUCCESS [ 1153.029055] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2989937c-6050-493e-a1d8-79a52d9b6132 deletion is rescheduled due to dependency. [ 1153.029055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.029055] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.531734] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.531734] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.531986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.532091] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.532122] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.532200] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be updated. [ 1153.561791] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.561941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.562020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.562255] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.562377] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.571709] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 1154.316636] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 in Status: SUCCESS [ 1154.317030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.317030] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.317266] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.317353] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52cb0804-8dc9-431c-b223-368ab8a8eb18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.819972] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-52cb0804-8dc9-431c-b223-368ab8a8eb18 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.820121] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.820312] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.820393] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.822444] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.822444] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.822444] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.822444] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.822444] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.822444] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.822444] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52cb0804-8dc9-431c-b223-368ab8a8eb18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.148787] env[66834]: INFO networking_nsxv3.common.synchronization [req-24477c20-3192-4796-9de3-50897374bf2f req-efb81b38-6dd7-424c-934b-4aff63a55c5b tempest-ServerActionsTestOtherA-283121819 tempest-ServerActionsTestOtherA-283121819-project-member] Enqueued Resource ID: 673eef00-b174-4a71-a870-466f27b577fd with Priority: HIGHEST for action security_group_members [ 1155.149505] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 673eef00-b174-4a71-a870-466f27b577fd with Priority: HIGHEST for action security_group_members [ 1155.149808] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-673eef00-b174-4a71-a870-466f27b577fd taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.149929] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.149998] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.150220] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.150373] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.150469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.150529] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.150672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.150757] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.150848] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('673eef00-b174-4a71-a870-466f27b577fd',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.196624] env[66834]: INFO networking_nsxv3.common.synchronization [req-24477c20-3192-4796-9de3-50897374bf2f req-efb81b38-6dd7-424c-934b-4aff63a55c5b tempest-ServerActionsTestOtherA-283121819 tempest-ServerActionsTestOtherA-283121819-project-member] Enqueued Resource ID: 968a2662-dc05-4a49-8014-9474b9df4204 with Priority: HIGHEST for action port [ 1155.197122] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 968a2662-dc05-4a49-8014-9474b9df4204 with Priority: HIGHEST for action port [ 1155.197417] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-968a2662-dc05-4a49-8014-9474b9df4204 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.197534] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-968a2662-dc05-4a49-8014-9474b9df4204" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.197600] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-968a2662-dc05-4a49-8014-9474b9df4204" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.197799] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-968a2662-dc05-4a49-8014-9474b9df4204" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.197872] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('968a2662-dc05-4a49-8014-9474b9df4204',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.324991] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-52cb0804-8dc9-431c-b223-368ab8a8eb18 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.324991] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.325412] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.325412] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.325471] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.325627] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.325627] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.325827] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.325941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.325941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.326092] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-52cb0804-8dc9-431c-b223-368ab8a8eb18 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.326264] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.326264] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.326389] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.326523] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.326613] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.326678] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.326846] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.327068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.327068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.327180] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52cb0804-8dc9-431c-b223-368ab8a8eb18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.581540] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 1155.581811] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.582050] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.582283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.582483] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.582617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.582749] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.582941] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.583033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.583121] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.583212] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.653291] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.653434] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.653497] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.653841] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.653971] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.654199] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.654314] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.654365] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.654538] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.654618] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.654707] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 673eef00-b174-4a71-a870-466f27b577fd is going to be updated. [ 1155.684338] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.684338] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.684338] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.684338] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.684585] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.693687] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 673eef00-b174-4a71-a870-466f27b577fd in Status: IN_PROGRESS for 2s [ 1155.700077] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 968a2662-dc05-4a49-8014-9474b9df4204 with status ACTIVE [ 1155.700490] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.700630] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.700699] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.700896] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.700986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.701177] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.701326] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.701392] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.701560] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.701635] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.701817] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.701911] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.701969] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.702114] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.702186] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.702270] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 968a2662-dc05-4a49-8014-9474b9df4204 is going to be updated. [ 1155.722721] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.722924] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.722924] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.723172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.723318] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.723529] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-968a2662-dc05-4a49-8014-9474b9df4204" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.829289] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52cb0804-8dc9-431c-b223-368ab8a8eb18: rpc.has_security_group_logging(os_id): False [ 1155.846604] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.846740] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.846820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.847031] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.847123] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.847316] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.847411] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.847475] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.847620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.847696] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.847876] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.847967] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.848038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.848179] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.848248] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.848439] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.848529] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.848586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.848720] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.848792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.848875] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 is going to be updated. [ 1155.962237] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.962374] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.962459] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.962717] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.962898] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.976334] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 in Status: IN_PROGRESS for 2s [ 1156.086626] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.086946] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.087087] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.088430] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.088737] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.088831] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.088943] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.089213] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.089353] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.089528] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.089743] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.089853] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.089922] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.090154] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.090373] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.090553] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.090553] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.090700] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.090797] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.091040] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.091100] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.596434] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c88662f-4694-4988-b716-56b85d22f3c9: rpc.has_security_group_logging(os_id): False [ 1156.620999] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.621243] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.621343] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.621570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.621687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.622103] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.622103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.622230] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.622310] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.622394] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.622622] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.622926] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.622926] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.623080] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.623080] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.623275] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.623366] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.623427] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.623600] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.623764] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.623881] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be updated. [ 1156.708370] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.708583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.708583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.708763] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.708914] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.775288] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 1157.704842] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 673eef00-b174-4a71-a870-466f27b577fd in Status: SUCCESS [ 1157.705270] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 673eef00-b174-4a71-a870-466f27b577fd deletion is rescheduled due to dependency. [ 1157.705335] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-673eef00-b174-4a71-a870-466f27b577fd" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.992147] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 in Status: SUCCESS [ 1157.992375] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.794899] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 1158.795240] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.433707] env[66834]: INFO networking_nsxv3.common.synchronization [req-094d25e2-225d-4bdf-b997-350b334d6865 req-dd5322d3-43be-499c-9e56-0a585945b9ba tempest-ServerRescueTestJSON-244035781 tempest-ServerRescueTestJSON-244035781-project-member] Enqueued Resource ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b with Priority: HIGHEST for action security_group_members [ 1159.434895] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b with Priority: HIGHEST for action security_group_members [ 1159.434959] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf09a47e-d4ed-48d3-bd2e-95954524a76b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.435195] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.435297] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.435668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.435903] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.436175] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.436384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.436773] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.436773] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.436773] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf09a47e-d4ed-48d3-bd2e-95954524a76b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.697026] env[66834]: INFO networking_nsxv3.common.synchronization [req-a44f75ec-6fa7-4502-9730-59a20370036a req-2b2dfad3-afa8-411f-8448-0f1f9a539af8 tempest-ServerActionsTestJSON-2105447671 tempest-ServerActionsTestJSON-2105447671-project-member] Enqueued Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_members [ 1159.697026] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_members [ 1159.697026] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b33fa48-b9ca-426c-b890-67d4639035e2 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.697026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.699428] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.700217] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.700217] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.700217] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.700217] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.700436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.700436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.700436] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.818862] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-280 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.819218] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-280" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.819443] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-280" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.819762] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-280" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.820078] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.820295] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.820459] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.820748] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.820899] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.821242] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1159.821328] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1159.821396] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1159.821499] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1159.821719] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1159.821719] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1159.821861] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1159.845869] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1159.846069] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1159.846211] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1159.846386] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-280" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.846828] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-f778e3cb-3e69-453a-861f-db3db691dc9d taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.846965] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-f778e3cb-3e69-453a-861f-db3db691dc9d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.847052] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-f778e3cb-3e69-453a-861f-db3db691dc9d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.847505] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-f778e3cb-3e69-453a-861f-db3db691dc9d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.847505] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f778e3cb-3e69-453a-861f-db3db691dc9d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.939686] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf09a47e-d4ed-48d3-bd2e-95954524a76b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.202532] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.202830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.202830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.203124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.203196] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.203475] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.203601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.203658] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.203852] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.203972] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.204070] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 is going to be updated. [ 1160.237850] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.238575] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.238665] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.239129] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.239527] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.251655] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 in Status: IN_PROGRESS for 2s [ 1160.350999] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.351399] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.351632] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.352109] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.352361] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.352614] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port f778e3cb-3e69-453a-861f-db3db691dc9d not found, creating... [ 1160.353081] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.353348] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.353455] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.353727] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.353883] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.354408] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.355325] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.355325] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.355325] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.355325] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.355578] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: f778e3cb-3e69-453a-861f-db3db691dc9d is going to be created. [ 1160.381289] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.381693] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.381693] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.381970] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.382336] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.382688] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-f778e3cb-3e69-453a-861f-db3db691dc9d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.441793] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf09a47e-d4ed-48d3-bd2e-95954524a76b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.944476] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.944899] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.944899] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.945441] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.945441] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.945441] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b is going to be updated. [ 1160.975595] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.975755] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.975839] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.976153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.976303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.987321] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b in Status: IN_PROGRESS for 2s [ 1161.089268] env[66834]: INFO networking_nsxv3.common.synchronization [req-094d25e2-225d-4bdf-b997-350b334d6865 req-b16b3126-b772-4de4-b95e-d791fc523441 service nova] Enqueued Resource ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b with Priority: HIGHEST for action security_group_rules [ 1161.089610] env[66834]: INFO networking_nsxv3.common.synchronization [req-094d25e2-225d-4bdf-b997-350b334d6865 req-b16b3126-b772-4de4-b95e-d791fc523441 service nova] Enqueued Resource ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b with Priority: HIGHEST for action security_group_members [ 1161.089857] env[66834]: INFO networking_nsxv3.common.synchronization [req-094d25e2-225d-4bdf-b997-350b334d6865 req-b16b3126-b772-4de4-b95e-d791fc523441 service nova] Enqueued Resource ID: f778e3cb-3e69-453a-861f-db3db691dc9d with Priority: HIGHEST for action port [ 1161.090991] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b with Priority: HIGHEST for action security_group_rules [ 1161.091217] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b with Priority: HIGHEST for action security_group_members [ 1161.091492] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f778e3cb-3e69-453a-861f-db3db691dc9d with Priority: HIGHEST for action port [ 1161.091983] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf09a47e-d4ed-48d3-bd2e-95954524a76b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.092167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.092260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.092527] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.092654] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf09a47e-d4ed-48d3-bd2e-95954524a76b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.094605] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf09a47e-d4ed-48d3-bd2e-95954524a76b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.094763] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.095036] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-f778e3cb-3e69-453a-861f-db3db691dc9d taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.095591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f778e3cb-3e69-453a-861f-db3db691dc9d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.095888] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f778e3cb-3e69-453a-861f-db3db691dc9d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.096272] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f778e3cb-3e69-453a-861f-db3db691dc9d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.096393] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f778e3cb-3e69-453a-861f-db3db691dc9d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.596013] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf09a47e-d4ed-48d3-bd2e-95954524a76b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.596241] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.599611] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f778e3cb-3e69-453a-861f-db3db691dc9d with status ACTIVE [ 1161.599818] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.599948] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.600034] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.600636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.600636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.600798] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.600972] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.601057] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.601298] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.601392] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.601606] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.601688] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.601747] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.601902] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.601975] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.602080] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f778e3cb-3e69-453a-861f-db3db691dc9d is going to be updated. [ 1161.625650] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.625902] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.625976] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.626316] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.626529] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.626789] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f778e3cb-3e69-453a-861f-db3db691dc9d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.262822] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 in Status: SUCCESS [ 1162.263207] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 deletion is rescheduled due to dependency. [ 1162.263292] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.999981] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b in Status: SUCCESS [ 1163.000290] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.000468] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.000692] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.001070] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.001210] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.001282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.001463] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.001548] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.001646] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf09a47e-d4ed-48d3-bd2e-95954524a76b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.503668] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf09a47e-d4ed-48d3-bd2e-95954524a76b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.007282] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf09a47e-d4ed-48d3-bd2e-95954524a76b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.216140] env[66834]: INFO networking_nsxv3.common.synchronization [req-41515f5b-0bff-4ccd-9adb-f0cb179606e0 req-d3c58ac1-002e-407e-a887-f1c296de7f4a tempest-ServersTestJSON-861266990 tempest-ServersTestJSON-861266990-project-member] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1164.218157] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1164.218490] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.218674] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.218674] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.219122] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.219122] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.219254] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.219323] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.219430] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.219986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.219986] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.510400] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.510400] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.510400] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.510858] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.510858] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.510858] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b is going to be updated. [ 1164.580032] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.580032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.580214] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.580336] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.580475] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.592411] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b in Status: IN_PROGRESS for 2s [ 1164.722247] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.224469] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.727350] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.727727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.727727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.727948] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.728146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.728146] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be updated. [ 1165.761607] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.762059] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.762059] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.762248] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.762728] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.773428] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 1166.603702] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b in Status: SUCCESS [ 1166.603935] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.604099] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.604333] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.604533] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.604724] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.604724] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.604863] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.604926] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.605018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.605122] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf09a47e-d4ed-48d3-bd2e-95954524a76b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.107568] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf09a47e-d4ed-48d3-bd2e-95954524a76b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.107879] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.107879] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.108055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.108254] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.108355] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.108418] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.108573] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.108673] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.108902] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.109121] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf09a47e-d4ed-48d3-bd2e-95954524a76b taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.109223] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.109281] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.109467] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.109634] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.109775] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.109858] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.110053] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.110150] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.110232] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.110323] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf09a47e-d4ed-48d3-bd2e-95954524a76b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.612495] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf09a47e-d4ed-48d3-bd2e-95954524a76b: rpc.has_security_group_logging(os_id): False [ 1167.638373] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.638638] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.638638] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.638822] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.638950] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.639220] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.639329] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.639392] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.639565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.639643] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.639904] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.640043] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.640141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.640296] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.640376] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.640572] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.640658] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.640722] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.640954] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.641066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.641156] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b is going to be updated. [ 1167.746320] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.746497] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.746558] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.746738] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.746913] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.771521] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b in Status: IN_PROGRESS for 2s [ 1167.785622] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 1167.785893] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.861129] env[66834]: INFO networking_nsxv3.common.synchronization [req-83e49d94-ab63-4d5f-a7d8-949e3a89a778 req-08cae99b-336b-4cd6-9c28-f3b09f8fe6dc tempest-ServerActionsTestJSON-2105447671 tempest-ServerActionsTestJSON-2105447671-project-member] Enqueued Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_members [ 1168.861791] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_members [ 1168.862321] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b33fa48-b9ca-426c-b890-67d4639035e2 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.862457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.862551] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.862776] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.863027] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.863139] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.863245] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.863371] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.863467] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.863561] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.249290] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-591 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.249290] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-591" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.249538] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-591" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.249694] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-591" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.249937] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.250140] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.250259] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.250482] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.250632] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.250885] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1169.251042] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1169.251107] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1169.251337] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1169.251409] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1169.251526] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1169.251644] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1169.275885] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1169.276246] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1169.276506] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1169.276800] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-591" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.277346] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-7217db5a-9e75-46ca-94cb-dbfe80091e61 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.277653] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-7217db5a-9e75-46ca-94cb-dbfe80091e61" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.277882] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-7217db5a-9e75-46ca-94cb-dbfe80091e61" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.278409] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-7217db5a-9e75-46ca-94cb-dbfe80091e61" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.278799] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7217db5a-9e75-46ca-94cb-dbfe80091e61',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.365825] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.365825] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.365825] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.366172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.366172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.366338] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.366444] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.366498] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.366654] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.366761] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.366824] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 is going to be updated. [ 1169.400291] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.400550] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.400550] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.400870] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.401090] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.415126] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 in Status: IN_PROGRESS for 2s [ 1169.782416] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.783147] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.783147] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.783147] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.783308] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.783522] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 7217db5a-9e75-46ca-94cb-dbfe80091e61 not found, creating... [ 1169.783783] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.784015] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.784163] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.784403] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.784571] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.784876] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.785216] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.785216] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.785499] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.785566] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.785853] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 7217db5a-9e75-46ca-94cb-dbfe80091e61 is going to be created. [ 1169.788269] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b in Status: SUCCESS [ 1169.788473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.813442] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.813671] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.813832] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.814103] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.814583] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.814583] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-7217db5a-9e75-46ca-94cb-dbfe80091e61" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.554097] env[66834]: INFO networking_nsxv3.common.synchronization [req-83e49d94-ab63-4d5f-a7d8-949e3a89a778 req-cebdbbdb-18da-4121-a27e-c47a81dcd4cf service nova] Enqueued Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_rules [ 1170.554535] env[66834]: INFO networking_nsxv3.common.synchronization [req-83e49d94-ab63-4d5f-a7d8-949e3a89a778 req-cebdbbdb-18da-4121-a27e-c47a81dcd4cf service nova] Enqueued Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_members [ 1170.554535] env[66834]: INFO networking_nsxv3.common.synchronization [req-83e49d94-ab63-4d5f-a7d8-949e3a89a778 req-cebdbbdb-18da-4121-a27e-c47a81dcd4cf service nova] Enqueued Resource ID: 7217db5a-9e75-46ca-94cb-dbfe80091e61 with Priority: HIGHEST for action port [ 1170.555491] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_rules [ 1170.556189] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_members [ 1170.556377] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7217db5a-9e75-46ca-94cb-dbfe80091e61 with Priority: HIGHEST for action port [ 1170.556695] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b33fa48-b9ca-426c-b890-67d4639035e2 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.556821] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.556889] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.557170] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.557285] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.561044] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b33fa48-b9ca-426c-b890-67d4639035e2 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.561247] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.561428] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-7217db5a-9e75-46ca-94cb-dbfe80091e61 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.561547] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7217db5a-9e75-46ca-94cb-dbfe80091e61" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.561907] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7217db5a-9e75-46ca-94cb-dbfe80091e61" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.562194] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7217db5a-9e75-46ca-94cb-dbfe80091e61" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.562309] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7217db5a-9e75-46ca-94cb-dbfe80091e61',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.947265] env[66834]: INFO networking_nsxv3.common.synchronization [req-fe589f95-15ff-45bd-a01c-0a93925a40e7 req-8de46c6d-0556-41e5-ba96-a9e48971fd58 tempest-AttachVolumeNegativeTest-457073585 tempest-AttachVolumeNegativeTest-457073585-project-member] Enqueued Resource ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 with Priority: HIGHEST for action security_group_members [ 1170.948049] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 with Priority: HIGHEST for action security_group_members [ 1170.948108] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-97cde620-d9a0-41c2-bb19-1e22ef3bc452 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.948228] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.948297] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.948507] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.948684] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.948803] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.948960] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.949103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.949148] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.949252] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97cde620-d9a0-41c2-bb19-1e22ef3bc452',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.064999] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b33fa48-b9ca-426c-b890-67d4639035e2 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.065247] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.065384] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7217db5a-9e75-46ca-94cb-dbfe80091e61 with status ACTIVE [ 1171.065682] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.065865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.065980] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.066367] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.066477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.066648] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.066793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.066851] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.066989] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.067073] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.067280] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.067419] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.067487] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.067634] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.067707] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.067792] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7217db5a-9e75-46ca-94cb-dbfe80091e61 is going to be updated. [ 1171.090692] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.090879] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.090961] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.091191] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.091334] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.091586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7217db5a-9e75-46ca-94cb-dbfe80091e61" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.427852] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 in Status: SUCCESS [ 1171.428057] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 deletion is rescheduled due to dependency. [ 1171.428258] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.428365] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.428577] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.428792] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.428926] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.428991] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.429183] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.429287] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.429386] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.451882] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.452149] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.452250] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.452511] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.452641] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.452891] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.453038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.453103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.453271] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.453670] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.453670] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 is going to be updated. [ 1171.481983] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.482166] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.482228] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.482435] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.482577] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.493075] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 in Status: IN_PROGRESS for 2s [ 1171.931858] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.434986] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.938555] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.938555] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.938555] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.938555] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.938555] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.938555] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 is going to be updated. [ 1172.969529] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.969529] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.969529] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.969529] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.969529] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.977806] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 in Status: IN_PROGRESS for 2s [ 1173.509730] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 in Status: SUCCESS [ 1173.510075] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 deletion is rescheduled due to dependency. [ 1173.510233] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.914262] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.914515] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-557" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.914682] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-557" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.915077] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-557" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.915456] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.915681] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.915852] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.916192] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.916428] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.916717] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1173.916885] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1173.917065] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1173.917228] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1173.917397] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1173.917560] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1173.917754] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1173.940162] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1173.940520] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1173.940520] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1173.940632] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-557" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.940965] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-2eac96d3-ba04-4eda-9c03-38b3a0153910 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.941156] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-2eac96d3-ba04-4eda-9c03-38b3a0153910" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.941274] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-2eac96d3-ba04-4eda-9c03-38b3a0153910" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.941539] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-2eac96d3-ba04-4eda-9c03-38b3a0153910" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.941673] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2eac96d3-ba04-4eda-9c03-38b3a0153910',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.152139] env[66834]: INFO networking_nsxv3.common.synchronization [req-59487e63-51d8-47dd-a15d-d07fa4ae37a5 req-2dfc62a5-6b20-4aae-beb4-5e78ed08b63c tempest-ServersTestJSON-861266990 tempest-ServersTestJSON-861266990-project-member] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1174.154549] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGHEST for action security_group_members [ 1174.154549] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.154549] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.154797] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.154797] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.154971] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.155042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.155097] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.155776] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.155776] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.155776] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.444195] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.444434] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.444559] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.444836] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.444986] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.445297] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.445450] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.445597] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.445781] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.446583] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.446583] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.446583] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.446583] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.446783] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.446783] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.446898] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 2eac96d3-ba04-4eda-9c03-38b3a0153910 is going to be updated. [ 1174.470616] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.470832] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.470944] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.471260] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.471525] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.471778] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-2eac96d3-ba04-4eda-9c03-38b3a0153910" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.661032] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.661032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.661032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.661032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.661032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.661032] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.661032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.661032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.661032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.661032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.661032] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be updated. [ 1174.701801] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.702050] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.702150] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.702413] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.702611] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.719521] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: IN_PROGRESS for 2s [ 1174.991301] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 in Status: SUCCESS [ 1174.991721] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.991784] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.991979] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.992205] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.992326] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.992422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.992620] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.992737] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.992830] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.993020] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.246023] env[66834]: INFO networking_nsxv3.common.synchronization [req-6f80d1bd-b0f4-46fe-b6e3-d1fe25b46cff req-6a80518d-396b-4178-80cd-92ab80950baa service nova] Enqueued Resource ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 with Priority: HIGHEST for action security_group_rules [ 1175.246023] env[66834]: INFO networking_nsxv3.common.synchronization [req-6f80d1bd-b0f4-46fe-b6e3-d1fe25b46cff req-6a80518d-396b-4178-80cd-92ab80950baa service nova] Enqueued Resource ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 with Priority: HIGHEST for action security_group_members [ 1175.246023] env[66834]: INFO networking_nsxv3.common.synchronization [req-6f80d1bd-b0f4-46fe-b6e3-d1fe25b46cff req-6a80518d-396b-4178-80cd-92ab80950baa service nova] Enqueued Resource ID: 2eac96d3-ba04-4eda-9c03-38b3a0153910 with Priority: HIGHEST for action port [ 1175.246023] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 with Priority: HIGHEST for action security_group_rules [ 1175.246023] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 with Priority: HIGHEST for action security_group_members [ 1175.246499] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eac96d3-ba04-4eda-9c03-38b3a0153910 with Priority: HIGHEST for action port [ 1175.248754] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c70a4c8a-c207-4934-8f56-cd2de91f4fb1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.248754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.248754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.248754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.248754] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c70a4c8a-c207-4934-8f56-cd2de91f4fb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.248754] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.248754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.248754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.249540] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.249827] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.250071] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.250263] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.250523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.250770] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.251567] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c70a4c8a-c207-4934-8f56-cd2de91f4fb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.251971] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-2eac96d3-ba04-4eda-9c03-38b3a0153910 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.253783] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2eac96d3-ba04-4eda-9c03-38b3a0153910" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.253783] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2eac96d3-ba04-4eda-9c03-38b3a0153910" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.253783] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2eac96d3-ba04-4eda-9c03-38b3a0153910" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.253783] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2eac96d3-ba04-4eda-9c03-38b3a0153910',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.497058] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.754178] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.754498] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.754612] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c70a4c8a-c207-4934-8f56-cd2de91f4fb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.757420] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2eac96d3-ba04-4eda-9c03-38b3a0153910 with status ACTIVE [ 1175.757663] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.757766] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.757766] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.758187] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.758187] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.758304] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.758431] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.758431] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.758567] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.758641] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.758817] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.758908] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.758984] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.759118] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.759190] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.759274] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2eac96d3-ba04-4eda-9c03-38b3a0153910 is going to be updated. [ 1175.787640] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.787825] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.787888] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.788145] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.788319] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.788505] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2eac96d3-ba04-4eda-9c03-38b3a0153910" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.999363] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b33fa48-b9ca-426c-b890-67d4639035e2: rpc.has_security_group_logging(os_id): False [ 1176.019195] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.019294] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.019366] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.019596] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.019683] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.019944] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.020055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.020115] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.020268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.020343] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.020433] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 is going to be updated. [ 1176.091550] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.091550] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.091550] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.091788] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.092025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.107443] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 in Status: IN_PROGRESS for 2s [ 1176.257500] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c70a4c8a-c207-4934-8f56-cd2de91f4fb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.731817] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c88662f-4694-4988-b716-56b85d22f3c9 in Status: SUCCESS [ 1176.731817] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 deletion is rescheduled due to dependency. [ 1176.731817] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.760655] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.760877] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.761101] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.761373] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.761502] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.761626] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 is going to be updated. [ 1176.791557] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.791721] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.791785] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.791999] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.792161] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.804741] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 in Status: IN_PROGRESS for 2s [ 1178.120314] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 in Status: SUCCESS [ 1178.120582] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.201864] env[66834]: INFO networking_nsxv3.common.synchronization [None req-07f15b1f-7cae-49ee-8767-8b41fc655e69 tempest-AttachVolumeNegativeTest-457073585 tempest-AttachVolumeNegativeTest-457073585-project-member] Enqueued Resource ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e with Priority: HIGHEST for action security_group_rules [ 1178.202506] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e with Priority: HIGHEST for action security_group_rules [ 1178.202831] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df231fd1-d2d8-4abc-b6ff-458d22e07e4e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.203025] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.203122] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.203370] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.203473] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df231fd1-d2d8-4abc-b6ff-458d22e07e4e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.339718] env[66834]: INFO networking_nsxv3.common.synchronization [None req-9f5b319b-a29e-4302-b2ce-e7d8e6f50dfa tempest-AttachVolumeNegativeTest-457073585 tempest-AttachVolumeNegativeTest-457073585-project-member] Enqueued Resource ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e with Priority: HIGHEST for action security_group_rules [ 1178.340411] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e with Priority: HIGHEST for action security_group_rules [ 1178.340756] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df231fd1-d2d8-4abc-b6ff-458d22e07e4e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.340937] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.728533] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.728916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.729272] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.729664] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.729863] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.730054] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e already deleted. [ 1178.730215] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.730452] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.730698] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.731635] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df231fd1-d2d8-4abc-b6ff-458d22e07e4e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.816449] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 in Status: SUCCESS [ 1178.816449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.816449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.816449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.816449] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.816449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.816449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.816846] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.816846] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.816846] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.816846] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c70a4c8a-c207-4934-8f56-cd2de91f4fb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.321448] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c70a4c8a-c207-4934-8f56-cd2de91f4fb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.331619] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.331795] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.331857] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.332086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.332187] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.332288] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e already deleted. [ 1179.332371] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.572591] env[66834]: INFO networking_nsxv3.common.synchronization [None req-b21b2797-1758-4e1a-95b8-6e6c5e863e91 tempest-ServerRescueNegativeTestJSON-599514552 tempest-ServerRescueNegativeTestJSON-599514552-project-member] Enqueued Resource ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 with Priority: HIGHEST for action security_group_rules [ 1179.573363] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 with Priority: HIGHEST for action security_group_rules [ 1179.573773] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.573943] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.574058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.574403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.574550] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aae6a6e9-1f82-4e25-9279-c0d1c3b5b593',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.707038] env[66834]: INFO networking_nsxv3.common.synchronization [None req-d7c809a8-2286-4270-970d-132a3bd2c2d2 tempest-ServerRescueNegativeTestJSON-599514552 tempest-ServerRescueNegativeTestJSON-599514552-project-member] Enqueued Resource ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 with Priority: HIGHEST for action security_group_rules [ 1179.707589] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 with Priority: HIGHEST for action security_group_rules [ 1179.707904] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.708184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.825992] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c70a4c8a-c207-4934-8f56-cd2de91f4fb1: rpc.has_security_group_logging(os_id): False [ 1179.846017] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.846227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.846295] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.846511] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.846619] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.846871] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.846972] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.847049] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.847200] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.847292] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.847378] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 is going to be updated. [ 1179.910379] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.910658] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.910735] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.911126] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.911292] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.924975] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 in Status: IN_PROGRESS for 2s [ 1180.107067] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.107067] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.107067] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.107067] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.107067] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.107067] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 already deleted. [ 1180.107067] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.107067] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.111990] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.111990] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aae6a6e9-1f82-4e25-9279-c0d1c3b5b593',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.636558] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.636907] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.636907] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.637429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.637429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.637429] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 already deleted. [ 1180.637429] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.950419] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 in Status: SUCCESS [ 1181.950419] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.350919] env[66834]: INFO networking_nsxv3.common.synchronization [req-f5e961b4-b6bd-4d7e-8236-6de5550d627c req-4cef1948-1956-4ed1-8910-f036ba946683 tempest-ServerActionsTestOtherA-283121819 tempest-ServerActionsTestOtherA-283121819-project-member] Enqueued Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGHEST for action security_group_members [ 1182.351610] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGHEST for action security_group_members [ 1182.352338] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.352338] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.352338] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.352667] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.352728] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.352977] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.352977] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.353157] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.353256] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.353321] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.805460] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.805460] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-590" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.805460] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-590" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.805460] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-590" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.805460] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.805460] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.806711] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.807126] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.808268] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.808268] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1182.808268] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1182.808268] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1182.808268] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1182.808268] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1182.808268] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1182.810112] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1182.839308] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1182.839481] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1182.839616] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1182.839799] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-590" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.840116] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-4ee68f1c-4697-44d8-ae8c-2b6f2c6279d6 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.840286] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-4ee68f1c-4697-44d8-ae8c-2b6f2c6279d6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.840400] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-4ee68f1c-4697-44d8-ae8c-2b6f2c6279d6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.840729] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-4ee68f1c-4697-44d8-ae8c-2b6f2c6279d6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.840862] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ee68f1c-4697-44d8-ae8c-2b6f2c6279d6',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.855783] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.346855] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.347240] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.347348] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.347611] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.347761] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.347970] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 4ee68f1c-4697-44d8-ae8c-2b6f2c6279d6 not found, creating... [ 1183.348335] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.348530] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.348657] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.348890] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.349134] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.349481] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.349674] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.349820] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.350074] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.350250] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.351029] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 4ee68f1c-4697-44d8-ae8c-2b6f2c6279d6 is going to be created. [ 1183.361501] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.374364] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.374559] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.374749] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.375107] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.375388] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.375705] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-4ee68f1c-4697-44d8-ae8c-2b6f2c6279d6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.865459] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.865459] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.865459] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.865459] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.865459] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.867018] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 is going to be updated. [ 1183.898424] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.899018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.899018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.899018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.899018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.918917] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 in Status: IN_PROGRESS for 2s [ 1184.116625] env[66834]: INFO networking_nsxv3.common.synchronization [req-f5e961b4-b6bd-4d7e-8236-6de5550d627c req-ec538c3a-1ee8-4d1d-a7c7-6bf864872b73 service nova] Enqueued Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGHEST for action security_group_rules [ 1184.116625] env[66834]: INFO networking_nsxv3.common.synchronization [req-f5e961b4-b6bd-4d7e-8236-6de5550d627c req-ec538c3a-1ee8-4d1d-a7c7-6bf864872b73 service nova] Enqueued Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGHEST for action security_group_members [ 1184.116625] env[66834]: INFO networking_nsxv3.common.synchronization [req-f5e961b4-b6bd-4d7e-8236-6de5550d627c req-ec538c3a-1ee8-4d1d-a7c7-6bf864872b73 service nova] Enqueued Resource ID: 4ee68f1c-4697-44d8-ae8c-2b6f2c6279d6 with Priority: HIGHEST for action port [ 1184.116625] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGHEST for action security_group_rules [ 1184.116625] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGHEST for action security_group_members [ 1184.116625] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee68f1c-4697-44d8-ae8c-2b6f2c6279d6 with Priority: HIGHEST for action port [ 1184.117412] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.117739] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.117924] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.118233] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.118424] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.121018] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.121018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.121018] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ee68f1c-4697-44d8-ae8c-2b6f2c6279d6 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.121018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ee68f1c-4697-44d8-ae8c-2b6f2c6279d6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.121018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ee68f1c-4697-44d8-ae8c-2b6f2c6279d6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.121018] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ee68f1c-4697-44d8-ae8c-2b6f2c6279d6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.121018] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ee68f1c-4697-44d8-ae8c-2b6f2c6279d6',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.628792] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4ee68f1c-4697-44d8-ae8c-2b6f2c6279d6 with status ACTIVE [ 1184.628792] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.628792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.628792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.628792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.628792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.628792] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.628792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.628792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.628792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.628792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.628792] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.628792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.628792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.628792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.628792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.628792] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4ee68f1c-4697-44d8-ae8c-2b6f2c6279d6 is going to be updated. [ 1184.629604] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.629604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.657307] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.657307] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.657307] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.657307] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.657307] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.657307] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ee68f1c-4697-44d8-ae8c-2b6f2c6279d6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.678415] env[66834]: INFO networking_nsxv3.common.synchronization [req-47a52801-7be7-4055-ab1f-1b567d76a95a req-866310b3-ef33-4b19-95ec-4e5100e5c1bd tempest-AttachVolumeNegativeTest-457073585 tempest-AttachVolumeNegativeTest-457073585-project-member] Enqueued Resource ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e with Priority: HIGHEST for action security_group_members [ 1184.678415] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e with Priority: HIGHEST for action security_group_members [ 1184.678415] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-df231fd1-d2d8-4abc-b6ff-458d22e07e4e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.678415] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.678415] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.678869] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.679184] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.679453] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.679647] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.681617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.681617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.681617] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df231fd1-d2d8-4abc-b6ff-458d22e07e4e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.034993] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-490 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.035682] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-490" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.035682] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-490" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.035682] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-490" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.036187] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.036187] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.036187] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.036740] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.036740] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.036851] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1185.036975] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1185.037097] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1185.037214] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1185.037341] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1185.037452] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1185.037583] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1185.056414] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1185.056572] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1185.056704] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1185.056935] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-490" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.057375] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-abba8f2b-9117-4c06-9bc8-f6b55c890ebb taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.057610] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-abba8f2b-9117-4c06-9bc8-f6b55c890ebb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.057820] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-abba8f2b-9117-4c06-9bc8-f6b55c890ebb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.059581] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-abba8f2b-9117-4c06-9bc8-f6b55c890ebb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.059774] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abba8f2b-9117-4c06-9bc8-f6b55c890ebb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.111995] env[66834]: INFO networking_nsxv3.common.synchronization [None req-a98001cc-7898-4f1f-aa21-4e4486288495 None None] Enqueued Resource ID: 6510550a-a256-4670-a8c6-2c474fcc61de with Priority: HIGHEST for action port [ 1185.112420] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6510550a-a256-4670-a8c6-2c474fcc61de with Priority: HIGHEST for action port [ 1185.112724] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-6510550a-a256-4670-a8c6-2c474fcc61de taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.112844] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6510550a-a256-4670-a8c6-2c474fcc61de" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.112921] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6510550a-a256-4670-a8c6-2c474fcc61de" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.113245] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6510550a-a256-4670-a8c6-2c474fcc61de" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.113325] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6510550a-a256-4670-a8c6-2c474fcc61de',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.183947] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.183947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.183947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.183947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.183947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.183947] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.183947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.183947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.183947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.183947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.183947] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e already deleted. [ 1185.183947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.564945] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.564945] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.564945] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.564945] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.564945] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.564945] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port abba8f2b-9117-4c06-9bc8-f6b55c890ebb not found, creating... [ 1185.564945] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.564945] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.564945] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.564945] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.564945] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.566212] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.566212] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.566212] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.566212] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.566212] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.566212] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: abba8f2b-9117-4c06-9bc8-f6b55c890ebb is going to be created. [ 1185.595054] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.595054] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.595054] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.595054] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.595054] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.595054] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-abba8f2b-9117-4c06-9bc8-f6b55c890ebb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.615233] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6510550a-a256-4670-a8c6-2c474fcc61de [ 1185.615571] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.615732] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.615789] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.615996] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.616515] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.616515] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6510550a-a256-4670-a8c6-2c474fcc61de already deleted. [ 1185.616515] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6510550a-a256-4670-a8c6-2c474fcc61de" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.936049] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 in Status: SUCCESS [ 1185.936049] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.936049] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.936049] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.936049] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.936049] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.936049] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.936049] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.936049] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.936049] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.369073] env[66834]: INFO networking_nsxv3.common.synchronization [req-47a52801-7be7-4055-ab1f-1b567d76a95a req-f2326d92-1227-417a-991a-e1e82925df75 service nova] Enqueued Resource ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e with Priority: HIGHEST for action security_group_rules [ 1186.369073] env[66834]: INFO networking_nsxv3.common.synchronization [req-47a52801-7be7-4055-ab1f-1b567d76a95a req-f2326d92-1227-417a-991a-e1e82925df75 service nova] Enqueued Resource ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e with Priority: HIGHEST for action security_group_members [ 1186.369073] env[66834]: INFO networking_nsxv3.common.synchronization [req-47a52801-7be7-4055-ab1f-1b567d76a95a req-f2326d92-1227-417a-991a-e1e82925df75 service nova] Enqueued Resource ID: abba8f2b-9117-4c06-9bc8-f6b55c890ebb with Priority: HIGHEST for action port [ 1186.369073] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e with Priority: HIGHEST for action security_group_rules [ 1186.369073] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e with Priority: HIGHEST for action security_group_members [ 1186.369073] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abba8f2b-9117-4c06-9bc8-f6b55c890ebb with Priority: HIGHEST for action port [ 1186.369638] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df231fd1-d2d8-4abc-b6ff-458d22e07e4e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.369766] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.369832] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.370057] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.370176] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df231fd1-d2d8-4abc-b6ff-458d22e07e4e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.371533] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-df231fd1-d2d8-4abc-b6ff-458d22e07e4e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.372376] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.372465] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.372745] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.376032] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.376032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.376032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.376032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.376032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.376032] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df231fd1-d2d8-4abc-b6ff-458d22e07e4e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.376032] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-abba8f2b-9117-4c06-9bc8-f6b55c890ebb taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.376032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abba8f2b-9117-4c06-9bc8-f6b55c890ebb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.376032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abba8f2b-9117-4c06-9bc8-f6b55c890ebb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.376631] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abba8f2b-9117-4c06-9bc8-f6b55c890ebb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.376631] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abba8f2b-9117-4c06-9bc8-f6b55c890ebb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.438431] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.878600] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-df231fd1-d2d8-4abc-b6ff-458d22e07e4e taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.878849] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.879125] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df231fd1-d2d8-4abc-b6ff-458d22e07e4e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.881275] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port abba8f2b-9117-4c06-9bc8-f6b55c890ebb with status ACTIVE [ 1186.881275] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.881275] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.882844] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.883032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.883098] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.883999] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.883999] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.883999] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.883999] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.884324] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.884514] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.884900] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.884900] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.885033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.885352] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.885352] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: abba8f2b-9117-4c06-9bc8-f6b55c890ebb is going to be updated. [ 1186.919138] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.919739] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.919739] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.919739] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.919739] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.919986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abba8f2b-9117-4c06-9bc8-f6b55c890ebb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.942573] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.388771] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df231fd1-d2d8-4abc-b6ff-458d22e07e4e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.445621] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.445621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.446919] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.446919] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.446919] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.446919] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 is going to be updated. [ 1187.488171] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.488171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.488171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.488171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.488171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.507488] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 in Status: IN_PROGRESS for 2s [ 1187.847502] env[66834]: INFO networking_nsxv3.common.synchronization [None req-d3380e43-38f5-4b9f-acae-bf5bbcbadafa None None] Enqueued Resource ID: 5b0295ef-b00b-46df-8908-d3e7c647d278 with Priority: HIGHEST for action port [ 1187.847929] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b0295ef-b00b-46df-8908-d3e7c647d278 with Priority: HIGHEST for action port [ 1187.848259] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b0295ef-b00b-46df-8908-d3e7c647d278 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.848400] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b0295ef-b00b-46df-8908-d3e7c647d278" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.848461] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b0295ef-b00b-46df-8908-d3e7c647d278" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.848701] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b0295ef-b00b-46df-8908-d3e7c647d278" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.848784] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b0295ef-b00b-46df-8908-d3e7c647d278',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.891900] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.892164] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.892164] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.892369] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.892460] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.892785] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e is going to be created. [ 1187.920468] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.920468] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.920709] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.920709] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.920852] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.931770] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e in Status: UNINITIALIZED for 2s [ 1188.032525] env[66834]: INFO networking_nsxv3.common.synchronization [None req-7f671268-ef92-4e74-a22a-60cfbe0db206 None None] Enqueued Resource ID: a3eaf06d-3bfb-488a-abde-fcc919b786aa with Priority: HIGHEST for action port [ 1188.033367] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3eaf06d-3bfb-488a-abde-fcc919b786aa with Priority: HIGHEST for action port [ 1188.033606] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3eaf06d-3bfb-488a-abde-fcc919b786aa taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.033766] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3eaf06d-3bfb-488a-abde-fcc919b786aa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.033884] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3eaf06d-3bfb-488a-abde-fcc919b786aa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.034513] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3eaf06d-3bfb-488a-abde-fcc919b786aa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.034605] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3eaf06d-3bfb-488a-abde-fcc919b786aa',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.351608] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b0295ef-b00b-46df-8908-d3e7c647d278 [ 1188.351844] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.351928] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.351995] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.352227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.352316] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.352411] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b0295ef-b00b-46df-8908-d3e7c647d278 already deleted. [ 1188.352491] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b0295ef-b00b-46df-8908-d3e7c647d278" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.539046] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a3eaf06d-3bfb-488a-abde-fcc919b786aa [ 1188.539046] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.539046] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.539046] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.539046] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.539046] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.539046] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a3eaf06d-3bfb-488a-abde-fcc919b786aa already deleted. [ 1188.539046] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3eaf06d-3bfb-488a-abde-fcc919b786aa" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.500687] env[66834]: INFO networking_nsxv3.common.synchronization [req-eaaa3dac-7087-4087-bbcb-a8cbf4d08340 req-f8ffb8b0-0380-4bb7-b257-0ca23194a669 tempest-ServerRescueNegativeTestJSON-599514552 tempest-ServerRescueNegativeTestJSON-599514552-project-member] Enqueued Resource ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 with Priority: HIGHEST for action security_group_members [ 1189.500968] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 with Priority: HIGHEST for action security_group_members [ 1189.501234] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.501387] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.501485] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.501770] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.501901] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.501970] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.502014] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.502455] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.502572] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.502638] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aae6a6e9-1f82-4e25-9279-c0d1c3b5b593',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.520735] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 in Status: SUCCESS [ 1189.520919] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.521433] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.521702] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.521910] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.522033] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.522099] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.522265] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.522334] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.522419] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.522505] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.872075] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-287 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.872301] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-287" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.872340] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-287" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.872715] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-287" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.873048] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.873367] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.873441] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.873691] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.873847] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.874161] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1189.874675] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1189.874784] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1189.874919] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1189.875092] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1189.875240] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1189.875455] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1189.898414] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1189.898610] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1189.898771] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1189.899015] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-287" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.899335] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-15088f71-644b-48c6-bf45-4717876bf143 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.899507] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-15088f71-644b-48c6-bf45-4717876bf143" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.899625] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-15088f71-644b-48c6-bf45-4717876bf143" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.899936] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-15088f71-644b-48c6-bf45-4717876bf143" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.900095] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15088f71-644b-48c6-bf45-4717876bf143',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.944095] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e in Status: SUCCESS [ 1189.944323] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.944773] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.948255] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.948551] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.948625] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.948664] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.949026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.949026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.949130] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.949160] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df231fd1-d2d8-4abc-b6ff-458d22e07e4e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.005133] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.005565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.005646] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.005871] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.005964] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.006180] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.006283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.006329] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.006472] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.006547] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.006631] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 already deleted. [ 1190.006710] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.024142] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.402763] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.402993] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.403166] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.403519] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.403677] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.403826] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 15088f71-644b-48c6-bf45-4717876bf143 not found, creating... [ 1190.404116] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.404308] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.404472] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.404697] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.404853] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.405163] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.405339] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.405472] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.405676] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.405805] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.405953] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 15088f71-644b-48c6-bf45-4717876bf143 is going to be created. [ 1190.427795] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.427795] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.427795] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.428049] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.428223] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.428890] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-15088f71-644b-48c6-bf45-4717876bf143" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.451863] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df231fd1-d2d8-4abc-b6ff-458d22e07e4e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.527463] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997: rpc.has_security_group_logging(os_id): False [ 1190.546508] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.546646] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.546767] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.546913] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.571148] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.571474] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.571596] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.571661] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.571867] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.571951] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.572165] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 is going to be updated. [ 1190.652783] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.652950] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.652992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.653257] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.653473] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.664862] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 in Status: IN_PROGRESS for 2s [ 1190.954870] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df231fd1-d2d8-4abc-b6ff-458d22e07e4e: rpc.has_security_group_logging(os_id): False [ 1190.978575] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.978843] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.978927] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.979100] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.979215] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.979585] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.979887] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.979887] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.980381] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.980381] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.980381] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e is going to be created. [ 1191.045259] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.045436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.045492] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.045872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.045872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.056958] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e in Status: IN_PROGRESS for 2s [ 1191.149979] env[66834]: INFO networking_nsxv3.common.synchronization [req-eaaa3dac-7087-4087-bbcb-a8cbf4d08340 req-b33986a0-d34f-4c91-8a6e-8cd6ccea1d4a service nova] Enqueued Resource ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 with Priority: HIGHEST for action security_group_rules [ 1191.149979] env[66834]: INFO networking_nsxv3.common.synchronization [req-eaaa3dac-7087-4087-bbcb-a8cbf4d08340 req-b33986a0-d34f-4c91-8a6e-8cd6ccea1d4a service nova] Enqueued Resource ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 with Priority: HIGHEST for action security_group_members [ 1191.149979] env[66834]: INFO networking_nsxv3.common.synchronization [req-eaaa3dac-7087-4087-bbcb-a8cbf4d08340 req-b33986a0-d34f-4c91-8a6e-8cd6ccea1d4a service nova] Enqueued Resource ID: 15088f71-644b-48c6-bf45-4717876bf143 with Priority: HIGHEST for action port [ 1191.150116] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 with Priority: HIGHEST for action security_group_rules [ 1191.150305] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 with Priority: HIGHEST for action security_group_members [ 1191.150449] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15088f71-644b-48c6-bf45-4717876bf143 with Priority: HIGHEST for action port [ 1191.150881] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.150991] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.151102] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.151596] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.151731] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aae6a6e9-1f82-4e25-9279-c0d1c3b5b593',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.152866] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.153028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.153161] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.153407] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.153614] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.153745] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.153834] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.154042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.154162] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.154293] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aae6a6e9-1f82-4e25-9279-c0d1c3b5b593',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.155344] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-15088f71-644b-48c6-bf45-4717876bf143 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.156035] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15088f71-644b-48c6-bf45-4717876bf143" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.156035] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15088f71-644b-48c6-bf45-4717876bf143" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.156035] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15088f71-644b-48c6-bf45-4717876bf143" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.156035] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15088f71-644b-48c6-bf45-4717876bf143',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.198646] env[66834]: INFO networking_nsxv3.common.synchronization [None req-64eb2c15-ef90-4550-8ec9-0bff6b528363 None None] Enqueued Resource ID: 347b125b-e7d4-4a3a-8d7d-27a70ebf60c3 with Priority: HIGHEST for action port [ 1191.199301] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 347b125b-e7d4-4a3a-8d7d-27a70ebf60c3 with Priority: HIGHEST for action port [ 1191.199774] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-347b125b-e7d4-4a3a-8d7d-27a70ebf60c3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.199919] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-347b125b-e7d4-4a3a-8d7d-27a70ebf60c3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.200056] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-347b125b-e7d4-4a3a-8d7d-27a70ebf60c3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.200434] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-347b125b-e7d4-4a3a-8d7d-27a70ebf60c3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.200585] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('347b125b-e7d4-4a3a-8d7d-27a70ebf60c3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.660533] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aae6a6e9-1f82-4e25-9279-c0d1c3b5b593',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.662397] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.662397] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.662711] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 15088f71-644b-48c6-bf45-4717876bf143 with status ACTIVE [ 1191.663220] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.663220] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.663220] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.663451] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.663763] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.663763] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.664184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.664184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.664184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.664184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.664574] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.664574] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.664574] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.664851] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.664851] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.664851] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 15088f71-644b-48c6-bf45-4717876bf143 is going to be updated. [ 1191.691637] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.692146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.692146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.692332] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.692916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.692916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15088f71-644b-48c6-bf45-4717876bf143" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.709925] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 347b125b-e7d4-4a3a-8d7d-27a70ebf60c3 [ 1191.709925] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.709925] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.709925] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.709925] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.709925] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.709925] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:347b125b-e7d4-4a3a-8d7d-27a70ebf60c3 already deleted. [ 1191.709925] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-347b125b-e7d4-4a3a-8d7d-27a70ebf60c3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.776027] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.776027] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-608" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.776027] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-608" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.776027] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-608" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.776027] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.776438] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.776663] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.776985] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.777252] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.777561] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1191.777782] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1191.777987] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1191.778209] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1191.778421] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1191.778687] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1191.778922] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1191.803891] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1191.803891] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1191.804188] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1191.804188] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-608" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.804550] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-20b6010b-150c-4231-8d8a-f73b6791118c taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.804748] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-20b6010b-150c-4231-8d8a-f73b6791118c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.804901] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-20b6010b-150c-4231-8d8a-f73b6791118c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.805263] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-20b6010b-150c-4231-8d8a-f73b6791118c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.805327] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20b6010b-150c-4231-8d8a-f73b6791118c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.162691] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aae6a6e9-1f82-4e25-9279-c0d1c3b5b593',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.308535] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.308721] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.308771] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.309799] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.309799] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.309799] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.309799] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.310203] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.310203] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.310316] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.310616] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.310770] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.310882] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.311172] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.311377] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.311618] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 20b6010b-150c-4231-8d8a-f73b6791118c is going to be updated. [ 1192.367452] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.367743] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.367815] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.368106] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.368310] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.368562] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-20b6010b-150c-4231-8d8a-f73b6791118c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.667679] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.668142] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.668142] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.668142] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.668283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.668462] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 is going to be created. [ 1192.687127] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 in Status: SUCCESS [ 1192.687365] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.696520] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.696666] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.696737] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.696975] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.697148] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.709968] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 in Status: UNINITIALIZED for 2s [ 1193.044356] env[66834]: INFO networking_nsxv3.common.synchronization [req-4548e780-bfc3-44ba-903b-0061448c8adc req-b659505d-745e-4398-8899-2d1cfd61fe32 service nova] Enqueued Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_rules [ 1193.044356] env[66834]: INFO networking_nsxv3.common.synchronization [req-4548e780-bfc3-44ba-903b-0061448c8adc req-b659505d-745e-4398-8899-2d1cfd61fe32 service nova] Enqueued Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_members [ 1193.044356] env[66834]: INFO networking_nsxv3.common.synchronization [req-4548e780-bfc3-44ba-903b-0061448c8adc req-b659505d-745e-4398-8899-2d1cfd61fe32 service nova] Enqueued Resource ID: 20b6010b-150c-4231-8d8a-f73b6791118c with Priority: HIGHEST for action port [ 1193.044597] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_rules [ 1193.044655] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_members [ 1193.045138] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20b6010b-150c-4231-8d8a-f73b6791118c with Priority: HIGHEST for action port [ 1193.045138] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06251551-417e-4f8a-9412-fdb5036f57fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.045308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.045308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.045541] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.045619] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.046491] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06251551-417e-4f8a-9412-fdb5036f57fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.046627] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.046685] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.046842] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.046963] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.047317] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.047317] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.047317] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.047317] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.050144] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.050144] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-20b6010b-150c-4231-8d8a-f73b6791118c taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.050144] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20b6010b-150c-4231-8d8a-f73b6791118c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.050144] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20b6010b-150c-4231-8d8a-f73b6791118c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.050144] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20b6010b-150c-4231-8d8a-f73b6791118c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.050144] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20b6010b-150c-4231-8d8a-f73b6791118c',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.073512] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e in Status: SUCCESS [ 1193.073776] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.308471] env[66834]: INFO networking_nsxv3.common.synchronization [req-c589ab6c-f893-44b8-ac5d-dcf27cdf4024 req-8df9a2fe-a68c-41fc-b61c-49eaf6b145ac tempest-ServerRescueTestJSON-244035781 tempest-ServerRescueTestJSON-244035781-project-member] Enqueued Resource ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b with Priority: HIGHEST for action security_group_members [ 1193.309044] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b with Priority: HIGHEST for action security_group_members [ 1193.309757] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf09a47e-d4ed-48d3-bd2e-95954524a76b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.309757] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.309915] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.311032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.311032] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.311032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.311032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.311220] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.311346] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.311524] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf09a47e-d4ed-48d3-bd2e-95954524a76b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.551474] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 20b6010b-150c-4231-8d8a-f73b6791118c with status ACTIVE [ 1193.552228] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.552228] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.552228] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.552427] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.552463] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.552625] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.552723] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.552924] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.552924] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.552997] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.553250] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.553372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.553508] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.553576] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.553634] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.553714] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 20b6010b-150c-4231-8d8a-f73b6791118c is going to be updated. [ 1193.556298] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.556298] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06251551-417e-4f8a-9412-fdb5036f57fe taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.556298] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.578069] env[66834]: INFO networking_nsxv3.common.synchronization [req-16468217-ed16-4593-b543-3c9fa6f3533e req-2183e283-a258-42aa-85b9-de7a9d3dc702 tempest-ServersNegativeTestMultiTenantJSON-816321878 tempest-ServersNegativeTestMultiTenantJSON-816321878-project-member] Enqueued Resource ID: b2373999-4b09-4e6b-b917-d763ef04d09e with Priority: HIGHEST for action security_group_members [ 1193.579120] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.579301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.579301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.579503] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.579639] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.579790] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20b6010b-150c-4231-8d8a-f73b6791118c" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.580287] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2373999-4b09-4e6b-b917-d763ef04d09e with Priority: HIGHEST for action security_group_members [ 1193.580505] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2373999-4b09-4e6b-b917-d763ef04d09e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.580612] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.580677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.580892] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.581061] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.581154] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.581223] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.581367] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.581445] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.581531] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2373999-4b09-4e6b-b917-d763ef04d09e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.814343] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf09a47e-d4ed-48d3-bd2e-95954524a76b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.904348] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.904348] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-844" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.904348] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-844" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.904536] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-844" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.904711] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.904908] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.905052] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.905274] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.905415] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.905624] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1193.905732] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1193.905835] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1193.905939] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1193.906063] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1193.906168] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1193.906297] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1193.927243] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1193.927470] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1193.927610] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1193.927829] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-844" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.928176] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-43d6fe2c-ea6f-4713-ac92-b9ceb660a807 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.928380] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-43d6fe2c-ea6f-4713-ac92-b9ceb660a807" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.928531] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-43d6fe2c-ea6f-4713-ac92-b9ceb660a807" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.928912] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-43d6fe2c-ea6f-4713-ac92-b9ceb660a807" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.929096] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43d6fe2c-ea6f-4713-ac92-b9ceb660a807',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.057428] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.084065] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.084241] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.084309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.084592] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.084685] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.084880] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.084982] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.085058] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.085351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.085351] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.085351] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2373999-4b09-4e6b-b917-d763ef04d09e already deleted. [ 1194.085534] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.317220] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf09a47e-d4ed-48d3-bd2e-95954524a76b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.432147] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.432414] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.432541] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.432858] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.433049] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.433201] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 43d6fe2c-ea6f-4713-ac92-b9ceb660a807 not found, creating... [ 1194.433473] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.433628] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.433770] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.434083] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.434446] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.434847] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.434983] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.435145] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.435394] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.435594] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.435846] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 43d6fe2c-ea6f-4713-ac92-b9ceb660a807 is going to be created. [ 1194.456512] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.456934] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.457331] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.458025] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.458466] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.458871] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-43d6fe2c-ea6f-4713-ac92-b9ceb660a807" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.560220] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.560388] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.560455] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.560679] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.560770] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.561068] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06251551-417e-4f8a-9412-fdb5036f57fe is going to be updated. [ 1194.598961] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.599210] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.599210] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.599398] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.599538] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.610942] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: IN_PROGRESS for 2s [ 1194.721084] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 in Status: SUCCESS [ 1194.721316] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.721494] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.721808] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.722026] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.722153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.722220] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.722384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.722466] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.722551] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.722640] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aae6a6e9-1f82-4e25-9279-c0d1c3b5b593',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.819310] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.819680] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.819680] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.819785] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.819841] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.819949] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b is going to be updated. [ 1194.861845] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.861845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.861845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.861845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.861845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.868384] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b in Status: IN_PROGRESS for 2s [ 1195.179949] env[66834]: INFO networking_nsxv3.common.synchronization [req-16468217-ed16-4593-b543-3c9fa6f3533e req-6dcb823b-13f5-4f0e-8239-075b9f6c4d86 service nova] Enqueued Resource ID: b2373999-4b09-4e6b-b917-d763ef04d09e with Priority: HIGHEST for action security_group_rules [ 1195.180150] env[66834]: INFO networking_nsxv3.common.synchronization [req-16468217-ed16-4593-b543-3c9fa6f3533e req-6dcb823b-13f5-4f0e-8239-075b9f6c4d86 service nova] Enqueued Resource ID: b2373999-4b09-4e6b-b917-d763ef04d09e with Priority: HIGHEST for action security_group_members [ 1195.180331] env[66834]: INFO networking_nsxv3.common.synchronization [req-16468217-ed16-4593-b543-3c9fa6f3533e req-6dcb823b-13f5-4f0e-8239-075b9f6c4d86 service nova] Enqueued Resource ID: 43d6fe2c-ea6f-4713-ac92-b9ceb660a807 with Priority: HIGHEST for action port [ 1195.180494] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2373999-4b09-4e6b-b917-d763ef04d09e with Priority: HIGHEST for action security_group_rules [ 1195.180616] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2373999-4b09-4e6b-b917-d763ef04d09e with Priority: HIGHEST for action security_group_members [ 1195.180708] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43d6fe2c-ea6f-4713-ac92-b9ceb660a807 with Priority: HIGHEST for action port [ 1195.181374] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2373999-4b09-4e6b-b917-d763ef04d09e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.181506] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.181571] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.181837] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.181924] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2373999-4b09-4e6b-b917-d763ef04d09e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.182764] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2373999-4b09-4e6b-b917-d763ef04d09e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.183277] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.183277] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.183516] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.183608] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.183821] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.183821] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.183960] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.184056] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.184123] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2373999-4b09-4e6b-b917-d763ef04d09e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.185950] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-43d6fe2c-ea6f-4713-ac92-b9ceb660a807 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.186082] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43d6fe2c-ea6f-4713-ac92-b9ceb660a807" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.186128] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43d6fe2c-ea6f-4713-ac92-b9ceb660a807" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.186279] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43d6fe2c-ea6f-4713-ac92-b9ceb660a807" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.186357] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43d6fe2c-ea6f-4713-ac92-b9ceb660a807',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.225849] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aae6a6e9-1f82-4e25-9279-c0d1c3b5b593',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.688208] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2373999-4b09-4e6b-b917-d763ef04d09e taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.688402] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.688535] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b2373999-4b09-4e6b-b917-d763ef04d09e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.691153] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43d6fe2c-ea6f-4713-ac92-b9ceb660a807 with status ACTIVE [ 1195.691372] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.691498] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.692059] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.692059] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.692059] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.692059] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.692346] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.692346] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.692404] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.692437] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.692813] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.692813] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.692813] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.692995] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.692995] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.692995] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43d6fe2c-ea6f-4713-ac92-b9ceb660a807 is going to be updated. [ 1195.728360] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aae6a6e9-1f82-4e25-9279-c0d1c3b5b593: rpc.has_security_group_logging(os_id): False [ 1195.737372] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.737822] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.737822] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.737822] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.737911] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.738209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43d6fe2c-ea6f-4713-ac92-b9ceb660a807" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.749355] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.749609] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.749609] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.749782] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.749864] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.750093] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.750204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.750267] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.750396] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.750458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.750649] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 is going to be created. [ 1195.831416] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.831798] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.831798] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.831937] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.832067] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.849200] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 in Status: IN_PROGRESS for 2s [ 1196.190295] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b2373999-4b09-4e6b-b917-d763ef04d09e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.622785] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: SUCCESS [ 1196.623439] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.623921] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.623921] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.624107] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.624209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.624348] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.624443] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.624528] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.624612] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.624702] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.693128] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.693362] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.693436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.693677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.693806] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.693909] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2373999-4b09-4e6b-b917-d763ef04d09e is going to be created. [ 1196.723662] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.723873] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.723873] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.724190] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.724336] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.735914] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2373999-4b09-4e6b-b917-d763ef04d09e in Status: UNINITIALIZED for 2s [ 1196.881770] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b in Status: SUCCESS [ 1196.882225] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.126775] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.629159] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06251551-417e-4f8a-9412-fdb5036f57fe: rpc.has_security_group_logging(os_id): False [ 1197.652594] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.652736] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.652736] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.653215] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.653322] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.653584] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.653690] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.653754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.653915] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.653990] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.654487] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06251551-417e-4f8a-9412-fdb5036f57fe is going to be updated. [ 1197.764443] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.764681] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.764732] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.764928] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.765101] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.792448] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: IN_PROGRESS for 2s [ 1197.861242] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 in Status: SUCCESS [ 1197.861447] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.746947] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2373999-4b09-4e6b-b917-d763ef04d09e in Status: SUCCESS [ 1198.746947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.747372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.747372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.747496] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.747625] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.747737] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.747930] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.748874] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.748874] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.748874] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b2373999-4b09-4e6b-b917-d763ef04d09e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.251407] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2373999-4b09-4e6b-b917-d763ef04d09e taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.251407] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.251572] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.251820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.252038] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.252357] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.252357] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.252471] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.252599] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.252802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.252947] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2373999-4b09-4e6b-b917-d763ef04d09e taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.253059] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.253109] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.253290] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.253473] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.253581] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.253857] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.253857] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.254237] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.254237] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.254237] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b2373999-4b09-4e6b-b917-d763ef04d09e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.756473] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b2373999-4b09-4e6b-b917-d763ef04d09e: rpc.has_security_group_logging(os_id): False [ 1199.776705] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.776937] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.777079] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.777401] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.777521] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.777769] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.777892] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.777988] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.778173] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.778274] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.778504] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.778627] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.778683] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.778859] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.778970] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.779587] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.779587] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.779587] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.780449] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.780487] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.780631] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2373999-4b09-4e6b-b917-d763ef04d09e is going to be created. [ 1199.806121] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: SUCCESS [ 1199.806319] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.841995] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.842282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.842282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.842569] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.842687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.857095] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2373999-4b09-4e6b-b917-d763ef04d09e in Status: IN_PROGRESS for 2s [ 1200.181632] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1200.181842] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1200.530945] env[66834]: INFO networking_nsxv3.common.synchronization [req-5fdf3170-c11a-4b2d-aa96-86e6060d7b5f req-c62f3b26-9f6b-4d4b-b85c-a629203c8937 tempest-ServerRescueTestJSON-244035781 tempest-ServerRescueTestJSON-244035781-project-member] Enqueued Resource ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b with Priority: HIGHEST for action security_group_members [ 1200.531493] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b with Priority: HIGHEST for action security_group_members [ 1200.532115] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf09a47e-d4ed-48d3-bd2e-95954524a76b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.532487] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.532750] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.533183] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.533591] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.535082] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.535082] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.535082] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.535082] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.535082] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf09a47e-d4ed-48d3-bd2e-95954524a76b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.038469] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.038469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.038469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.038469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.038469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.039021] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.039021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.039021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.039021] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.039216] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.039972] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b is going to be updated. [ 1201.076058] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.076267] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.076267] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.076411] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.076553] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.085966] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b in Status: IN_PROGRESS for 2s [ 1201.872374] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2373999-4b09-4e6b-b917-d763ef04d09e in Status: SUCCESS [ 1201.872631] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.100424] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b in Status: SUCCESS [ 1203.100778] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b deletion is rescheduled due to dependency. [ 1203.100778] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.532249] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1205.532625] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1207.171639] env[66834]: INFO networking_nsxv3.common.synchronization [req-b8753a71-e173-4296-971c-aaaa07d0d6fc req-3bb796d1-a4b8-49be-b7ec-e6d6521116ef tempest-ServersNegativeTestMultiTenantJSON-816321878 tempest-ServersNegativeTestMultiTenantJSON-816321878-project-member] Enqueued Resource ID: b2373999-4b09-4e6b-b917-d763ef04d09e with Priority: HIGHEST for action security_group_members [ 1207.171639] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2373999-4b09-4e6b-b917-d763ef04d09e with Priority: HIGHEST for action security_group_members [ 1207.172022] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2373999-4b09-4e6b-b917-d763ef04d09e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.172022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.172116] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.172292] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.172428] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.172605] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.172605] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.173904] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.173904] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.173904] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2373999-4b09-4e6b-b917-d763ef04d09e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.676114] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.676377] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.676377] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.676593] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.676689] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.676891] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.676993] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.677073] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.677222] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.677300] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.677387] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2373999-4b09-4e6b-b917-d763ef04d09e is going to be updated. [ 1207.711141] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.711399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.711483] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.711718] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.711867] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.733891] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2373999-4b09-4e6b-b917-d763ef04d09e in Status: IN_PROGRESS for 2s [ 1209.746353] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2373999-4b09-4e6b-b917-d763ef04d09e in Status: SUCCESS [ 1209.746740] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2373999-4b09-4e6b-b917-d763ef04d09e deletion is rescheduled due to dependency. [ 1209.746740] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.173072] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1212.173754] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1213.979425] env[66834]: INFO networking_nsxv3.common.synchronization [req-75793a78-391e-44d6-b2b5-ee4bba52fda8 req-64920c29-0603-4032-9a9d-c9dc1822054f tempest-ServerActionsTestOtherB-2089780499 tempest-ServerActionsTestOtherB-2089780499-project-member] Enqueued Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_members [ 1213.980221] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGHEST for action security_group_members [ 1213.980633] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-06251551-417e-4f8a-9412-fdb5036f57fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.980793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.980883] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.981153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.981740] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.981903] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.981993] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.982212] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.982328] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.982453] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.485077] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.485077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.485077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.485332] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.485332] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.485511] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.485615] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.485683] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.485831] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.485906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.485993] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06251551-417e-4f8a-9412-fdb5036f57fe is going to be updated. [ 1214.514146] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.514298] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.514298] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.514479] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.514650] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.523498] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: IN_PROGRESS for 2s [ 1216.535844] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06251551-417e-4f8a-9412-fdb5036f57fe in Status: SUCCESS [ 1216.535844] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06251551-417e-4f8a-9412-fdb5036f57fe deletion is rescheduled due to dependency. [ 1216.535844] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.980963] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1218.981370] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1223.982037] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1223.982037] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1228.983285] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1228.983581] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1233.984493] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1233.984837] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1235.030156] env[66834]: INFO networking_nsxv3.common.synchronization [req-ce60d523-c3f2-4e10-9d4f-6fcd9ad05f72 req-9b053bac-5b65-465f-8970-ebe311a2bac5 tempest-ServerActionsTestJSON-2105447671 tempest-ServerActionsTestJSON-2105447671-project-member] Enqueued Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_members [ 1235.030731] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGHEST for action security_group_members [ 1235.031084] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b33fa48-b9ca-426c-b890-67d4639035e2 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.031218] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.031289] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.032344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.032344] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.032344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.032344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.032344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.032589] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.032589] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.206931] env[66834]: INFO networking_nsxv3.common.synchronization [req-cf50f677-c832-4fce-b33f-24b7b3dddf43 req-77768a30-5e9a-44b7-a1f1-3183643ca048 tempest-AttachVolumeShelveTestJSON-172859501 tempest-AttachVolumeShelveTestJSON-172859501-project-member] Enqueued Resource ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 with Priority: HIGHEST for action security_group_members [ 1235.207294] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 with Priority: HIGHEST for action security_group_members [ 1235.207604] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.209611] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.209611] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.209611] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.209611] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.209611] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.209611] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.209611] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.209611] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.209611] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c70a4c8a-c207-4934-8f56-cd2de91f4fb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.537141] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.537395] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.537508] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.537826] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.537964] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.538312] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.538484] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.538593] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.538844] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.538964] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.539117] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 is going to be updated. [ 1235.569644] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.569813] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.569858] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.570080] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.570533] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.580623] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 in Status: IN_PROGRESS for 2s [ 1235.715457] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.715457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.715457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.715457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.715457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.715457] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.715457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.715457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.715457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.715457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.715457] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 is going to be updated. [ 1235.744662] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.744662] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.744662] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.744662] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.744662] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.755727] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 in Status: IN_PROGRESS for 2s [ 1237.590989] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 in Status: SUCCESS [ 1237.591341] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 deletion is rescheduled due to dependency. [ 1237.591454] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.766367] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 in Status: SUCCESS [ 1237.766565] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 deletion is rescheduled due to dependency. [ 1237.766649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.208695] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1240.208695] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1242.194242] env[66834]: INFO networking_nsxv3.common.synchronization [None req-97692720-a032-4731-b7a9-741b0cc37dc6 tempest-AttachVolumeShelveTestJSON-172859501 tempest-AttachVolumeShelveTestJSON-172859501-project-member] Enqueued Resource ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f with Priority: HIGHEST for action security_group_rules [ 1242.194861] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f with Priority: HIGHEST for action security_group_rules [ 1242.195538] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb96d654-f9e7-43ce-b22e-df261ce3be7f taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.195696] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.195787] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.196196] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.196311] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb96d654-f9e7-43ce-b22e-df261ce3be7f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.304365] env[66834]: INFO networking_nsxv3.common.synchronization [None req-2dd8592a-56c1-40c8-ac14-22105f736a8e tempest-AttachVolumeShelveTestJSON-172859501 tempest-AttachVolumeShelveTestJSON-172859501-project-member] Enqueued Resource ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f with Priority: HIGHEST for action security_group_rules [ 1242.305064] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f with Priority: HIGHEST for action security_group_rules [ 1242.305467] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb96d654-f9e7-43ce-b22e-df261ce3be7f taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.305695] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.719994] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.720202] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.720275] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.720543] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.720636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.720731] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f already deleted. [ 1242.720855] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.720983] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.721180] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.721265] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb96d654-f9e7-43ce-b22e-df261ce3be7f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.242484] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.242872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.242872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.242872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.242988] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.243033] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f already deleted. [ 1243.243183] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.297863] env[66834]: INFO networking_nsxv3.common.synchronization [None req-532d0a03-eca9-42c2-91ab-69a38649b9f9 None None] Enqueued Resource ID: f5f2a104-afa9-4c91-93c1-4f012313a6a5 with Priority: HIGHEST for action port [ 1244.298434] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5f2a104-afa9-4c91-93c1-4f012313a6a5 with Priority: HIGHEST for action port [ 1244.298745] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5f2a104-afa9-4c91-93c1-4f012313a6a5 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.298866] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5f2a104-afa9-4c91-93c1-4f012313a6a5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.298925] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5f2a104-afa9-4c91-93c1-4f012313a6a5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.299194] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5f2a104-afa9-4c91-93c1-4f012313a6a5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.299264] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5f2a104-afa9-4c91-93c1-4f012313a6a5',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.801144] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5f2a104-afa9-4c91-93c1-4f012313a6a5 [ 1244.801467] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.801615] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.801743] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.802079] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.802290] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.803967] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5f2a104-afa9-4c91-93c1-4f012313a6a5 already deleted. [ 1244.803967] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5f2a104-afa9-4c91-93c1-4f012313a6a5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.913401] env[66834]: INFO networking_nsxv3.common.synchronization [None req-bd74deca-6e41-45d2-b96b-7251a9abda9c tempest-ServerActionsV293TestJSON-582429360 tempest-ServerActionsV293TestJSON-582429360-project-member] Enqueued Resource ID: 849b7083-c8aa-4040-9084-38d57e44aa72 with Priority: HIGHEST for action security_group_rules [ 1244.914209] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 849b7083-c8aa-4040-9084-38d57e44aa72 with Priority: HIGHEST for action security_group_rules [ 1244.914647] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-849b7083-c8aa-4040-9084-38d57e44aa72 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.914878] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.914878] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.915205] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.915261] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('849b7083-c8aa-4040-9084-38d57e44aa72',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.999818] env[66834]: INFO networking_nsxv3.common.synchronization [None req-8fe5c173-0ffa-439f-8340-a7cb4df555e2 tempest-ServerActionsV293TestJSON-582429360 tempest-ServerActionsV293TestJSON-582429360-project-member] Enqueued Resource ID: 849b7083-c8aa-4040-9084-38d57e44aa72 with Priority: HIGHEST for action security_group_rules [ 1245.000461] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 849b7083-c8aa-4040-9084-38d57e44aa72 with Priority: HIGHEST for action security_group_rules [ 1245.000825] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-849b7083-c8aa-4040-9084-38d57e44aa72 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.001125] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.437317] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.437623] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.437623] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.437734] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.437819] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.437921] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 849b7083-c8aa-4040-9084-38d57e44aa72 already deleted. [ 1245.438011] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.438166] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.438317] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.438396] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('849b7083-c8aa-4040-9084-38d57e44aa72',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.959066] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.959305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.959459] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.959725] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.959880] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.960099] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 849b7083-c8aa-4040-9084-38d57e44aa72 already deleted. [ 1245.960222] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.523964] env[66834]: INFO networking_nsxv3.common.synchronization [None req-ccffbc9f-1acc-46a9-93bd-ace81856c192 None None] Enqueued Resource ID: d140be21-961e-4f41-aba7-ea372e7f3583 with Priority: HIGHEST for action port [ 1246.524539] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d140be21-961e-4f41-aba7-ea372e7f3583 with Priority: HIGHEST for action port [ 1246.524851] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-d140be21-961e-4f41-aba7-ea372e7f3583 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.524973] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d140be21-961e-4f41-aba7-ea372e7f3583" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.525052] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d140be21-961e-4f41-aba7-ea372e7f3583" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.525302] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d140be21-961e-4f41-aba7-ea372e7f3583" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.525384] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d140be21-961e-4f41-aba7-ea372e7f3583',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.027784] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d140be21-961e-4f41-aba7-ea372e7f3583 [ 1247.028133] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.028322] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.028444] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.028734] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.028827] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.028949] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d140be21-961e-4f41-aba7-ea372e7f3583 already deleted. [ 1247.029060] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d140be21-961e-4f41-aba7-ea372e7f3583" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.165060] env[66834]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1248.165402] env[66834]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] NSXv3 Agent Agent loop - iteration:3 started [ 1248.230702] env[66834]: INFO networking_nsxv3.common.synchronization [req-e495abdb-7883-4736-89e9-91cf3d9ab8e5 req-0ea716ee-1111-47ca-ae12-39d3644a0a43 tempest-AttachVolumeShelveTestJSON-172859501 tempest-AttachVolumeShelveTestJSON-172859501-project-member] Enqueued Resource ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f with Priority: HIGHEST for action security_group_members [ 1248.232241] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f with Priority: HIGHEST for action security_group_members [ 1248.232241] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb96d654-f9e7-43ce-b22e-df261ce3be7f taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.232241] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.232241] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.232551] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.232551] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.232551] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.232714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.232714] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.232813] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.232911] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb96d654-f9e7-43ce-b22e-df261ce3be7f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.598530] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.598530] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-557" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.598530] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-557" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.598772] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-557" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.599019] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.599207] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.599321] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.599544] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.599689] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.599896] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1248.600016] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1248.600301] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1248.600415] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1248.600527] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1248.600632] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1248.600764] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1248.623923] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1248.624146] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1248.624248] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1248.624421] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-557" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.624903] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-7b747d01-d674-45d2-85d2-dc1b1c53cadb taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.625068] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-7b747d01-d674-45d2-85d2-dc1b1c53cadb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.625171] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-7b747d01-d674-45d2-85d2-dc1b1c53cadb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.625553] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-7b747d01-d674-45d2-85d2-dc1b1c53cadb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.625616] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b747d01-d674-45d2-85d2-dc1b1c53cadb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.736180] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.736419] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.736419] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.736609] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.736707] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.736897] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.736996] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.737070] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.737235] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.737305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.737386] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f already deleted. [ 1248.737458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.127977] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.128268] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.128410] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.128680] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.128825] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.129007] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 7b747d01-d674-45d2-85d2-dc1b1c53cadb not found, creating... [ 1249.129301] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.129507] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.129682] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.129981] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.130182] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.130539] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.130747] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.130873] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.131209] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.131374] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.131547] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 7b747d01-d674-45d2-85d2-dc1b1c53cadb is going to be created. [ 1249.156947] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.157242] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.157311] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.157586] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.157830] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.158127] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-7b747d01-d674-45d2-85d2-dc1b1c53cadb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.871134] env[66834]: INFO networking_nsxv3.common.synchronization [req-e495abdb-7883-4736-89e9-91cf3d9ab8e5 req-26d4dba3-e263-4dee-a34c-48b7f9a37fcf service nova] Enqueued Resource ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f with Priority: HIGHEST for action security_group_rules [ 1249.871419] env[66834]: INFO networking_nsxv3.common.synchronization [req-e495abdb-7883-4736-89e9-91cf3d9ab8e5 req-26d4dba3-e263-4dee-a34c-48b7f9a37fcf service nova] Enqueued Resource ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f with Priority: HIGHEST for action security_group_members [ 1249.871514] env[66834]: INFO networking_nsxv3.common.synchronization [req-e495abdb-7883-4736-89e9-91cf3d9ab8e5 req-26d4dba3-e263-4dee-a34c-48b7f9a37fcf service nova] Enqueued Resource ID: 7b747d01-d674-45d2-85d2-dc1b1c53cadb with Priority: HIGHEST for action port [ 1249.872611] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f with Priority: HIGHEST for action security_group_rules [ 1249.874107] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f with Priority: HIGHEST for action security_group_members [ 1249.874107] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b747d01-d674-45d2-85d2-dc1b1c53cadb with Priority: HIGHEST for action port [ 1249.874107] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb96d654-f9e7-43ce-b22e-df261ce3be7f taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.874107] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.874107] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.874107] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.874107] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb96d654-f9e7-43ce-b22e-df261ce3be7f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.875165] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb96d654-f9e7-43ce-b22e-df261ce3be7f taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.875300] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.875370] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.875546] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.875724] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.875811] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.875874] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.876048] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.876151] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.876261] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb96d654-f9e7-43ce-b22e-df261ce3be7f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.878638] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b747d01-d674-45d2-85d2-dc1b1c53cadb taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.878638] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b747d01-d674-45d2-85d2-dc1b1c53cadb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.878638] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b747d01-d674-45d2-85d2-dc1b1c53cadb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.878638] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b747d01-d674-45d2-85d2-dc1b1c53cadb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.878638] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b747d01-d674-45d2-85d2-dc1b1c53cadb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.379687] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb96d654-f9e7-43ce-b22e-df261ce3be7f taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.379840] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.380111] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb96d654-f9e7-43ce-b22e-df261ce3be7f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.381048] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b747d01-d674-45d2-85d2-dc1b1c53cadb with status ACTIVE [ 1250.381265] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.381380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.381441] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.382490] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.382490] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.382490] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.382490] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.382490] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.382490] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.382490] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.383940] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.383940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.383940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.383940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.383940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.383940] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b747d01-d674-45d2-85d2-dc1b1c53cadb is going to be updated. [ 1250.404163] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.404382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.404382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.404591] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.404729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.404891] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b747d01-d674-45d2-85d2-dc1b1c53cadb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.598071] env[66834]: INFO networking_nsxv3.common.synchronization [req-f52c9e19-673a-4547-bf54-f040eb8f51eb req-272af376-8a28-4617-9da6-4534482f6a40 tempest-AttachVolumeNegativeTest-457073585 tempest-AttachVolumeNegativeTest-457073585-project-member] Enqueued Resource ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e with Priority: HIGHEST for action security_group_members [ 1250.598588] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e with Priority: HIGHEST for action security_group_members [ 1250.598907] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-df231fd1-d2d8-4abc-b6ff-458d22e07e4e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.599037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.599102] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.599301] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.599451] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.599549] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.599612] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.599758] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.599842] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.599940] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df231fd1-d2d8-4abc-b6ff-458d22e07e4e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.886470] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb96d654-f9e7-43ce-b22e-df261ce3be7f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.103416] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.103641] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.103750] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.104439] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.104553] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.104800] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.104928] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.104973] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.105255] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.105359] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.105430] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e is going to be updated. [ 1251.134076] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.134268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.134268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.134478] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.134685] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.143399] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e in Status: IN_PROGRESS for 2s [ 1251.388579] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.388802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.388802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.388990] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.389099] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.389200] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f is going to be created. [ 1251.414431] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.414646] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.414646] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.414965] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.415168] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.425487] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f in Status: UNINITIALIZED for 2s [ 1253.154303] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e in Status: SUCCESS [ 1253.154695] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e deletion is rescheduled due to dependency. [ 1253.154695] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.436284] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f in Status: SUCCESS [ 1253.436496] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.436668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.436907] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.437140] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.437946] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.437946] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.437946] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.437946] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.437946] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.437946] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb96d654-f9e7-43ce-b22e-df261ce3be7f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.940057] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb96d654-f9e7-43ce-b22e-df261ce3be7f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.441324] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb96d654-f9e7-43ce-b22e-df261ce3be7f: rpc.has_security_group_logging(os_id): False [ 1254.459244] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.459450] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.459450] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.459671] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.459762] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.460013] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.460126] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.460187] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.460342] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.460417] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.460502] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f is going to be created. [ 1254.515779] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.515983] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.516037] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.516280] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.516516] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.529300] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f in Status: IN_PROGRESS for 2s [ 1255.599723] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1255.600105] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1256.115037] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.115365] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.115480] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.115928] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.116144] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.542233] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f in Status: SUCCESS [ 1256.542461] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.619375] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.122015] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.624675] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1257.625173] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1258.513394] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.513569] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.513688] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.513969] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.528356] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1258.529274] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.531049] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1258.579512] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.579752] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.579752] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.579963] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.597453] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.598387] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1258.598477] env[66834]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66834) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1258.598574] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1258.636033] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.636560] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.636560] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.636560] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.637856] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.638088] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1258.713038] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.713038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.713038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.714034] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.714034] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.714368] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1258.802838] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.802987] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.803072] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.803677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.803677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.804043] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:41. [ 1258.804136] env[66834]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'a15c14c6-0aee-4e9d-b481-2661c510f44a', '97cde620-d9a0-41c2-bb19-1e22ef3bc452', 'ac8e3a64-d540-43bb-a864-6d42bf3a44c4', '72ef45f6-6e2c-41d2-8697-fa5b38d00b3b', '0d437be3-ac8e-4142-becb-dfc82235f8e5', '52cb0804-8dc9-431c-b223-368ab8a8eb18', 'c70a4c8a-c207-4934-8f56-cd2de91f4fb1', 'aae6a6e9-1f82-4e25-9279-c0d1c3b5b593', '4a374bf1-dcb9-4b0d-a02d-5649cc882880', '2989937c-6050-493e-a1d8-79a52d9b6132', 'c936d9b1-70e6-41ff-b4fc-481a320e93bf', '3ac1b684-ee07-41f3-926b-106a37b82e05', '482d0336-6e92-4922-86a3-e6d489211f48', '44bd23af-d078-428a-9579-9dc775303088', '4cdb75fc-c0b5-4b9d-843f-f2ae58af6997', 'b11bc7eb-c1bb-49d4-8347-38576752a094', '599d582a-c0d7-4df7-a1fe-3e63412d8939', '782e10e2-c275-4c7b-bb67-ec47dc30cf73', '1262896d-5f2c-4d6b-8695-adeea78ba3f6', '1c88662f-4694-4988-b716-56b85d22f3c9', '87920817-9bc0-40b2-945a-8057b5158162', '06251551-417e-4f8a-9412-fdb5036f57fe', '0750b6a7-8358-4db0-b46f-3ccbf925625d', 'a4da628c-f2f0-417c-917f-a8cc4350870b', 'c40be9d7-369b-4cf1-88e7-d822d62fa7f1', '98a1f729-8e05-4426-8db7-2c883443f0e8', '8ef26513-917e-4754-b69d-1d511bcb585b', 'bf09a47e-d4ed-48d3-bd2e-95954524a76b', 'b2373999-4b09-4e6b-b917-d763ef04d09e', '7b33fa48-b9ca-426c-b890-67d4639035e2', 'df231fd1-d2d8-4abc-b6ff-458d22e07e4e', '659c3ecb-b49f-4d7f-8978-4e0221530e96', '6b93eb01-51cc-4c25-b2fa-56b4a62620d3', '06c1d39f-c76e-47c4-9900-046863c4e37a', 'f46326b4-7843-4c05-8eca-cb73edd99c30', '61dc46c7-365b-480f-83e5-16cbc578a879', 'e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c', '4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4', '7963c125-23b5-45fd-8158-f6470d12949e', '673eef00-b174-4a71-a870-466f27b577fd', 'eb96d654-f9e7-43ce-b22e-df261ce3be7f'} {{(pid=66834) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1258.804269] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1258.823303] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.823543] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.823649] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.823910] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.824042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.824182] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1258.824257] env[66834]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66834) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1258.824334] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1258.916767] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.916945] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.916989] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.917222] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.918494] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.918782] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1258.918901] env[66834]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66834) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1258.919011] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1258.919095] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1258.919176] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/41 resources of Type:Security Group Rules [ 1258.919249] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGH for action security_group_rules [ 1258.919329] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 with Priority: HIGH for action security_group_rules [ 1258.919396] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 with Priority: HIGH for action security_group_rules [ 1258.919457] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGH for action security_group_rules [ 1258.919554] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 with Priority: HIGH for action security_group_rules [ 1258.919589] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 with Priority: HIGH for action security_group_rules [ 1258.919627] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 with Priority: HIGH for action security_group_rules [ 1258.919679] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 with Priority: HIGH for action security_group_rules [ 1258.919739] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 with Priority: HIGH for action security_group_rules [ 1258.919801] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGH for action security_group_rules [ 1258.919893] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf with Priority: HIGH for action security_group_rules [ 1258.919980] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 with Priority: HIGH for action security_group_rules [ 1258.920058] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 482d0336-6e92-4922-86a3-e6d489211f48 with Priority: HIGH for action security_group_rules [ 1258.920120] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 44bd23af-d078-428a-9579-9dc775303088 with Priority: HIGH for action security_group_rules [ 1258.920205] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGH for action security_group_rules [ 1258.920286] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b11bc7eb-c1bb-49d4-8347-38576752a094 with Priority: HIGH for action security_group_rules [ 1258.920346] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGH for action security_group_rules [ 1258.920410] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 with Priority: HIGH for action security_group_rules [ 1258.920472] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1262896d-5f2c-4d6b-8695-adeea78ba3f6 with Priority: HIGH for action security_group_rules [ 1258.920532] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGH for action security_group_rules [ 1258.920636] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.820446] env[66834]: INFO networking_nsxv3.common.synchronization [req-7ba1ce4e-9c89-4b30-8d9e-b69043a1a2c4 req-df454d6c-cebe-4c88-aa0a-34e24d32c833 tempest-ServerActionsTestOtherA-283121819 tempest-ServerActionsTestOtherA-283121819-project-member] Enqueued Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGHEST for action security_group_members [ 1259.821690] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGHEST for action security_group_members [ 1259.822060] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15c14c6-0aee-4e9d-b481-2661c510f44a with Priority: HIGH for action security_group_rules [ 1259.822060] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 with Priority: HIGH for action security_group_rules [ 1259.822223] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 with Priority: HIGH for action security_group_rules [ 1259.822647] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGH for action security_group_rules [ 1259.822647] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88662f-4694-4988-b716-56b85d22f3c9 with Priority: HIGH for action security_group_rules [ 1259.822741] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1262896d-5f2c-4d6b-8695-adeea78ba3f6 with Priority: HIGH for action security_group_rules [ 1259.822810] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 with Priority: HIGH for action security_group_rules [ 1259.823254] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 with Priority: HIGH for action security_group_rules [ 1259.823254] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44bd23af-d078-428a-9579-9dc775303088 with Priority: HIGH for action security_group_rules [ 1259.823352] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b11bc7eb-c1bb-49d4-8347-38576752a094 with Priority: HIGH for action security_group_rules [ 1259.823439] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482d0336-6e92-4922-86a3-e6d489211f48 with Priority: HIGH for action security_group_rules [ 1259.823821] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 with Priority: HIGH for action security_group_rules [ 1259.823821] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf with Priority: HIGH for action security_group_rules [ 1259.823821] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989937c-6050-493e-a1d8-79a52d9b6132 with Priority: HIGH for action security_group_rules [ 1259.824045] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 with Priority: HIGH for action security_group_rules [ 1259.824245] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 with Priority: HIGH for action security_group_rules [ 1259.824325] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 with Priority: HIGH for action security_group_rules [ 1259.824448] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 with Priority: HIGH for action security_group_rules [ 1259.824540] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 with Priority: HIGH for action security_group_rules [ 1259.824636] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b with Priority: HIGH for action security_group_rules [ 1259.824995] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.825279] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.825279] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.825777] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.825777] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.825777] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.825777] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.825986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.825986] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.826087] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.827788] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a15c14c6-0aee-4e9d-b481-2661c510f44a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.827926] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.827992] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.828335] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.828335] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a15c14c6-0aee-4e9d-b481-2661c510f44a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.829230] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac8e3a64-d540-43bb-a864-6d42bf3a44c4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.830155] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.830155] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.830155] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.830390] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac8e3a64-d540-43bb-a864-6d42bf3a44c4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.831583] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c70a4c8a-c207-4934-8f56-cd2de91f4fb1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.831583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.831583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.831716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.831747] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c70a4c8a-c207-4934-8f56-cd2de91f4fb1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.832825] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.834044] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.834044] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.834044] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.834044] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.835205] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c88662f-4694-4988-b716-56b85d22f3c9 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.835377] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.836158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.836158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.836158] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c88662f-4694-4988-b716-56b85d22f3c9',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.838077] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1262896d-5f2c-4d6b-8695-adeea78ba3f6 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.838523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.838523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.839067] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.839067] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1262896d-5f2c-4d6b-8695-adeea78ba3f6',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.840876] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-782e10e2-c275-4c7b-bb67-ec47dc30cf73 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.840876] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.840876] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.840876] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.840876] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('782e10e2-c275-4c7b-bb67-ec47dc30cf73',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.842116] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-599d582a-c0d7-4df7-a1fe-3e63412d8939 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.842314] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.842420] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.842716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.842924] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('599d582a-c0d7-4df7-a1fe-3e63412d8939',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.846633] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44bd23af-d078-428a-9579-9dc775303088 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.846872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.846872] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.846958] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.847515] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44bd23af-d078-428a-9579-9dc775303088',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.847822] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b11bc7eb-c1bb-49d4-8347-38576752a094 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.847927] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.847994] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.848174] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.848247] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b11bc7eb-c1bb-49d4-8347-38576752a094',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.848967] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-482d0336-6e92-4922-86a3-e6d489211f48 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.849089] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.849153] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.849308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.849378] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('482d0336-6e92-4922-86a3-e6d489211f48',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.850188] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ac1b684-ee07-41f3-926b-106a37b82e05 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.850298] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.850363] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.850514] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.850583] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ac1b684-ee07-41f3-926b-106a37b82e05',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.851282] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c936d9b1-70e6-41ff-b4fc-481a320e93bf taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.851408] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.851546] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.855022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.855022] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c936d9b1-70e6-41ff-b4fc-481a320e93bf',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.855022] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2989937c-6050-493e-a1d8-79a52d9b6132 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.855022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.855022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.855022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.855022] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2989937c-6050-493e-a1d8-79a52d9b6132',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.855022] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a374bf1-dcb9-4b0d-a02d-5649cc882880 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.855438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.855438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.855438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.855521] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a374bf1-dcb9-4b0d-a02d-5649cc882880',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.857326] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52cb0804-8dc9-431c-b223-368ab8a8eb18 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.857434] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.857493] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.857660] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.857733] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52cb0804-8dc9-431c-b223-368ab8a8eb18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.859223] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.859329] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.859393] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.859550] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.859632] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aae6a6e9-1f82-4e25-9279-c0d1c3b5b593',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.860412] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d437be3-ac8e-4142-becb-dfc82235f8e5 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.860529] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.860612] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.860765] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.860848] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d437be3-ac8e-4142-becb-dfc82235f8e5',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.862222] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97cde620-d9a0-41c2-bb19-1e22ef3bc452 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.862346] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.862411] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.862589] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.862663] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97cde620-d9a0-41c2-bb19-1e22ef3bc452',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.863849] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.863983] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.864066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.864228] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.864301] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72ef45f6-6e2c-41d2-8697-fa5b38d00b3b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.870239] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.905678] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.905678] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.905901] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.905963] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.908043] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.908043] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.908703] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.908840] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.909484] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.909604] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.932897] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.933134] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a15c14c6-0aee-4e9d-b481-2661c510f44a is going to be deleted. [ 1259.934688] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.934917] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.957212] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.957386] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 782e10e2-c275-4c7b-bb67-ec47dc30cf73 is going to be deleted. [ 1259.958436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.958655] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.977450] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.977631] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c88662f-4694-4988-b716-56b85d22f3c9 is going to be deleted. [ 1259.978826] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.979101] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.011024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.011024] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac8e3a64-d540-43bb-a864-6d42bf3a44c4 is going to be deleted. [ 1260.012926] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.013128] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.013213] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.013486] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.013608] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.013763] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a15c14c6-0aee-4e9d-b481-2661c510f44a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.039709] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.039920] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.039967] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.040215] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.040309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.040425] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-782e10e2-c275-4c7b-bb67-ec47dc30cf73" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.055848] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.056063] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.056063] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.056286] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.056380] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.056500] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c88662f-4694-4988-b716-56b85d22f3c9" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.096214] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.096418] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.096464] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.096771] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.096909] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.097113] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac8e3a64-d540-43bb-a864-6d42bf3a44c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.360047] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-52cb0804-8dc9-431c-b223-368ab8a8eb18 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.360141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.360141] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.360357] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.360510] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.360605] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.360663] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.360811] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.360893] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.360977] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.361077] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52cb0804-8dc9-431c-b223-368ab8a8eb18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.370659] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.370858] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.370858] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.371049] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.371206] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.371304] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.371373] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.371505] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.371586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.371668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.371750] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aae6a6e9-1f82-4e25-9279-c0d1c3b5b593',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.380414] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.380615] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.382036] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.382036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.382224] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.382489] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.388685] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.388786] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.390103] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.392576] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.392703] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.394974] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.395102] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.419615] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.419840] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.421138] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.421297] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.422014] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.422146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.422842] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.422937] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.423662] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.423751] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.424581] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.424733] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.425679] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.425779] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.426396] env[66834]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1260.426795] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.426898] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.427454] env[66834]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1260.427859] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.427970] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c936d9b1-70e6-41ff-b4fc-481a320e93bf is going to be deleted. [ 1260.428844] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.429056] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.430397] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.430492] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.447888] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.448296] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a374bf1-dcb9-4b0d-a02d-5649cc882880 is going to be deleted. [ 1260.449248] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.449489] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.466737] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.466881] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97cde620-d9a0-41c2-bb19-1e22ef3bc452 is going to be deleted. [ 1260.467762] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.467967] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.493109] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.493309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.494580] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.494688] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72ef45f6-6e2c-41d2-8697-fa5b38d00b3b is going to be deleted. [ 1260.495586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.495788] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.497735] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.497844] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.518028] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.518028] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c70a4c8a-c207-4934-8f56-cd2de91f4fb1 is going to be deleted. [ 1260.518682] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.518902] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.520317] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.520425] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.554532] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.554696] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ac1b684-ee07-41f3-926b-106a37b82e05 is going to be deleted. [ 1260.555673] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.555881] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.630703] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.630928] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.632653] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.632857] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1262896d-5f2c-4d6b-8695-adeea78ba3f6 is going to be deleted. [ 1260.633786] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.634133] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.635625] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.635625] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.653372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.653557] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 599d582a-c0d7-4df7-a1fe-3e63412d8939 is going to be deleted. [ 1260.654621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.654906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.656436] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.656544] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.679710] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.679882] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 482d0336-6e92-4922-86a3-e6d489211f48 is going to be deleted. [ 1260.680836] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.681174] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.706715] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.706893] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b11bc7eb-c1bb-49d4-8347-38576752a094 is going to be deleted. [ 1260.707845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.708086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.726924] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.727140] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.737639] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.737828] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.741098] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.741234] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44bd23af-d078-428a-9579-9dc775303088 is going to be deleted. [ 1260.742157] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.742371] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.822584] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.822959] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2989937c-6050-493e-a1d8-79a52d9b6132 is going to be deleted. [ 1260.823699] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.823963] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.835717] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.835717] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.863843] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-52cb0804-8dc9-431c-b223-368ab8a8eb18 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.864072] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.864286] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.864677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.864947] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.865128] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.865231] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.865485] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.865625] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.865779] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.866017] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-52cb0804-8dc9-431c-b223-368ab8a8eb18 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.866167] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.866378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.866586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.866778] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.866913] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.866993] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.867156] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.867237] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.867319] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.867413] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52cb0804-8dc9-431c-b223-368ab8a8eb18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.884543] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aae6a6e9-1f82-4e25-9279-c0d1c3b5b593',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.891423] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.891927] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d437be3-ac8e-4142-becb-dfc82235f8e5 is going to be deleted. [ 1260.892943] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.893270] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.893410] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.893597] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c936d9b1-70e6-41ff-b4fc-481a320e93bf" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.893839] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.894105] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.894248] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.894432] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a374bf1-dcb9-4b0d-a02d-5649cc882880" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.895749] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.895920] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.896014] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.896193] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97cde620-d9a0-41c2-bb19-1e22ef3bc452" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.896393] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.896680] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.896822] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.897014] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72ef45f6-6e2c-41d2-8697-fa5b38d00b3b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.897476] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.897638] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.897729] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.897924] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.898049] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.898181] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 is going to be updated. [ 1260.899968] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.900209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.900321] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.900539] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c70a4c8a-c207-4934-8f56-cd2de91f4fb1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.900739] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.900946] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.901081] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.901250] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ac1b684-ee07-41f3-926b-106a37b82e05" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.901930] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.902147] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.902253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.902423] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-599d582a-c0d7-4df7-a1fe-3e63412d8939" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.903073] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.903297] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.903411] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.903576] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1262896d-5f2c-4d6b-8695-adeea78ba3f6" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.904157] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.904360] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.904469] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.904617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-482d0336-6e92-4922-86a3-e6d489211f48" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.927599] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.927800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.927907] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.928225] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.928369] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.928563] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b11bc7eb-c1bb-49d4-8347-38576752a094" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.935996] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.936173] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.936258] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.936481] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.936572] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.936690] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44bd23af-d078-428a-9579-9dc775303088" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.957340] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.957648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.957648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.957773] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.957828] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.957950] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2989937c-6050-493e-a1d8-79a52d9b6132" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.991297] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.991445] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.991586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.991824] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.992793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.010407] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 in Status: IN_PROGRESS for 2s [ 1261.041262] env[66834]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1261.042283] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.042537] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.042648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.042939] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.043099] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.043303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d437be3-ac8e-4142-becb-dfc82235f8e5" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.369777] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52cb0804-8dc9-431c-b223-368ab8a8eb18: rpc.has_security_group_logging(os_id): False [ 1261.387656] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aae6a6e9-1f82-4e25-9279-c0d1c3b5b593: rpc.has_security_group_logging(os_id): False [ 1261.391167] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.391352] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.391408] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.391615] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.408361] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.408547] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.410615] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.410838] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.410985] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.411089] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.411296] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.411381] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.411580] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.411681] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.411740] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.412129] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.412244] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.412513] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.412645] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.412751] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.413055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.413181] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.413218] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 is going to be updated. [ 1261.414495] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.414736] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.440026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.440275] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.440439] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.440496] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.440717] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.440783] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.440885] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 is going to be updated. [ 1261.478140] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.478313] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.478366] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.478558] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.478699] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.489856] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 in Status: IN_PROGRESS for 2s [ 1261.496817] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.496960] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.497038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.497261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.497401] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.515144] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 in Status: IN_PROGRESS for 2s [ 1263.023032] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 in Status: SUCCESS [ 1263.023032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.023032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.023032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.023032] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.023032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.023032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.023032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.023032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.023032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.023032] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.501761] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 in Status: SUCCESS [ 1263.502134] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.525317] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.530354] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 in Status: SUCCESS [ 1263.530575] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.027472] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997: rpc.has_security_group_logging(os_id): False [ 1264.046114] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.046205] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.046257] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.046567] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.065792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.066169] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.066300] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.066368] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.066577] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.066692] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.066746] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 is going to be updated. [ 1264.126473] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.126619] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.126683] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.126895] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.127050] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.142662] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 in Status: IN_PROGRESS for 2s [ 1264.825804] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1264.825979] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1266.206225] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 in Status: SUCCESS [ 1266.206617] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.132589] env[66834]: INFO networking_nsxv3.common.synchronization [req-8aeb3253-5887-410a-9f91-1f816eb715ba req-8e09412d-a017-4a68-bcca-7c3013b90f38 tempest-ServerActionsV293TestJSON-582429360 tempest-ServerActionsV293TestJSON-582429360-project-member] Enqueued Resource ID: 849b7083-c8aa-4040-9084-38d57e44aa72 with Priority: HIGHEST for action security_group_members [ 1269.133143] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 849b7083-c8aa-4040-9084-38d57e44aa72 with Priority: HIGHEST for action security_group_members [ 1269.133457] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-849b7083-c8aa-4040-9084-38d57e44aa72 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.133581] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.133646] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.133891] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.134075] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.134238] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.134238] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.134382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.134465] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.134555] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('849b7083-c8aa-4040-9084-38d57e44aa72',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.398158] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-81 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.398354] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-81" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.398474] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-81" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.398820] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-81" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.399093] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.399252] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.399362] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.399580] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.399718] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.399917] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1269.400076] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1269.400157] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1269.400260] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1269.400364] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1269.400466] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1269.400591] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1269.419402] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1269.419551] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1269.419685] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1269.419854] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-81" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.420170] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-61b5f3c6-1b61-4656-acc0-419d60d1b1b7 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.420337] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-61b5f3c6-1b61-4656-acc0-419d60d1b1b7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.420452] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-61b5f3c6-1b61-4656-acc0-419d60d1b1b7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.420770] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-61b5f3c6-1b61-4656-acc0-419d60d1b1b7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.420904] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61b5f3c6-1b61-4656-acc0-419d60d1b1b7',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.637044] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.637210] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.637255] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.637450] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.637540] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.637736] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.637836] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.637898] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.638067] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.638152] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.638260] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 849b7083-c8aa-4040-9084-38d57e44aa72 already deleted. [ 1269.638345] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.924097] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.924097] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.924097] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.924097] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.924456] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.924456] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 61b5f3c6-1b61-4656-acc0-419d60d1b1b7 not found, creating... [ 1269.924555] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.924708] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.924824] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.925060] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.925200] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.925477] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.925630] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.925742] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.925945] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.926100] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.926248] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 61b5f3c6-1b61-4656-acc0-419d60d1b1b7 is going to be created. [ 1269.946380] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.946587] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.946708] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.946977] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.947223] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.947448] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-61b5f3c6-1b61-4656-acc0-419d60d1b1b7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.061540] env[66834]: INFO networking_nsxv3.common.synchronization [req-8aeb3253-5887-410a-9f91-1f816eb715ba req-2612a31d-c8e8-49af-ae81-df82c9ac6435 service nova] Enqueued Resource ID: 849b7083-c8aa-4040-9084-38d57e44aa72 with Priority: HIGHEST for action security_group_rules [ 1271.061780] env[66834]: INFO networking_nsxv3.common.synchronization [req-8aeb3253-5887-410a-9f91-1f816eb715ba req-2612a31d-c8e8-49af-ae81-df82c9ac6435 service nova] Enqueued Resource ID: 849b7083-c8aa-4040-9084-38d57e44aa72 with Priority: HIGHEST for action security_group_members [ 1271.061864] env[66834]: INFO networking_nsxv3.common.synchronization [req-8aeb3253-5887-410a-9f91-1f816eb715ba req-2612a31d-c8e8-49af-ae81-df82c9ac6435 service nova] Enqueued Resource ID: 61b5f3c6-1b61-4656-acc0-419d60d1b1b7 with Priority: HIGHEST for action port [ 1271.062463] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 849b7083-c8aa-4040-9084-38d57e44aa72 with Priority: HIGHEST for action security_group_rules [ 1271.062601] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 849b7083-c8aa-4040-9084-38d57e44aa72 with Priority: HIGHEST for action security_group_members [ 1271.062698] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61b5f3c6-1b61-4656-acc0-419d60d1b1b7 with Priority: HIGHEST for action port [ 1271.063848] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-849b7083-c8aa-4040-9084-38d57e44aa72 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.063997] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.064311] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.064311] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.064473] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('849b7083-c8aa-4040-9084-38d57e44aa72',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.065678] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-849b7083-c8aa-4040-9084-38d57e44aa72 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.065834] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.065969] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.066189] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.066362] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.066468] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.066531] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.066688] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.066774] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.066864] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('849b7083-c8aa-4040-9084-38d57e44aa72',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.067709] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-61b5f3c6-1b61-4656-acc0-419d60d1b1b7 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.067820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61b5f3c6-1b61-4656-acc0-419d60d1b1b7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.067886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61b5f3c6-1b61-4656-acc0-419d60d1b1b7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.069138] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61b5f3c6-1b61-4656-acc0-419d60d1b1b7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.069261] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61b5f3c6-1b61-4656-acc0-419d60d1b1b7',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.570839] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('849b7083-c8aa-4040-9084-38d57e44aa72',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.572067] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-849b7083-c8aa-4040-9084-38d57e44aa72 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.572237] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.572554] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 61b5f3c6-1b61-4656-acc0-419d60d1b1b7 with status ACTIVE [ 1271.572719] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.572836] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.572898] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.574509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.574509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.574509] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.574509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.574509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.574509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.574509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.574509] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.574509] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.574806] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.574806] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.574806] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.574886] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 61b5f3c6-1b61-4656-acc0-419d60d1b1b7 is going to be updated. [ 1271.596647] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.596800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.596954] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.597192] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.597356] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.597546] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61b5f3c6-1b61-4656-acc0-419d60d1b1b7" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.073334] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('849b7083-c8aa-4040-9084-38d57e44aa72',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.575205] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.575372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.575420] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.575632] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.575719] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.575834] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 849b7083-c8aa-4040-9084-38d57e44aa72 is going to be created. [ 1272.610095] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.610349] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.610349] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.610517] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.610677] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.624865] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 849b7083-c8aa-4040-9084-38d57e44aa72 in Status: UNINITIALIZED for 2s [ 1274.637319] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 849b7083-c8aa-4040-9084-38d57e44aa72 in Status: SUCCESS [ 1274.637711] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.637754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.637972] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.638208] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.638343] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.638407] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.638556] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.638628] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.638709] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.638801] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('849b7083-c8aa-4040-9084-38d57e44aa72',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.141630] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('849b7083-c8aa-4040-9084-38d57e44aa72',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.644455] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 849b7083-c8aa-4040-9084-38d57e44aa72: rpc.has_security_group_logging(os_id): False [ 1275.663532] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.663747] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.663747] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.663960] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.664103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.664348] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.664453] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.664542] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.664731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.664807] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.664896] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 849b7083-c8aa-4040-9084-38d57e44aa72 is going to be created. [ 1275.723151] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.723403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.723403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.723605] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.723777] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.734391] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 849b7083-c8aa-4040-9084-38d57e44aa72 in Status: IN_PROGRESS for 2s [ 1276.064229] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1276.064229] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1276.388581] env[66834]: INFO networking_nsxv3.common.synchronization [req-583fb83e-8042-4600-8f2a-3c769fcb1c7c req-9b1827e9-c1c6-441b-aebe-2147ff3e6c25 tempest-ServerActionsTestOtherA-283121819 tempest-ServerActionsTestOtherA-283121819-project-member] Enqueued Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGHEST for action security_group_members [ 1276.388684] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGHEST for action security_group_members [ 1276.388987] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.389129] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.389208] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.389386] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.389533] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.389623] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.389689] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.389836] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.390177] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.390177] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.892742] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.893195] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.893195] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.893195] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.893322] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.893469] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.893560] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.893624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.893771] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.893845] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.893930] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 is going to be updated. [ 1276.922906] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.923172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.923172] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.923656] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.923656] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.932417] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 in Status: IN_PROGRESS for 2s [ 1277.762501] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 849b7083-c8aa-4040-9084-38d57e44aa72 in Status: SUCCESS [ 1277.762501] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.942659] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 in Status: SUCCESS [ 1278.943057] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 deletion is rescheduled due to dependency. [ 1278.943057] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.389747] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1281.390163] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1285.114780] env[66834]: INFO networking_nsxv3.common.synchronization [None req-5abbe663-d13d-4b1e-a880-cb5066f69203 None None] Enqueued Resource ID: 7ef92b62-759c-47a5-b920-6e289ff1c24b with Priority: HIGHEST for action port [ 1285.115403] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef92b62-759c-47a5-b920-6e289ff1c24b with Priority: HIGHEST for action port [ 1285.115677] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ef92b62-759c-47a5-b920-6e289ff1c24b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.115796] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ef92b62-759c-47a5-b920-6e289ff1c24b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.115854] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ef92b62-759c-47a5-b920-6e289ff1c24b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.117147] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ef92b62-759c-47a5-b920-6e289ff1c24b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.117247] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ef92b62-759c-47a5-b920-6e289ff1c24b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.620792] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ef92b62-759c-47a5-b920-6e289ff1c24b [ 1285.620792] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.620792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.620792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.620792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.620792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.620792] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ef92b62-759c-47a5-b920-6e289ff1c24b already deleted. [ 1285.620792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ef92b62-759c-47a5-b920-6e289ff1c24b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.167196] env[66834]: INFO networking_nsxv3.common.synchronization [None req-898e3d0c-4679-4e6c-a1f2-f8b587782bc0 None None] Enqueued Resource ID: ec03e992-b1f0-4be8-baa4-c389c269769d with Priority: HIGHEST for action port [ 1287.167708] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec03e992-b1f0-4be8-baa4-c389c269769d with Priority: HIGHEST for action port [ 1287.168019] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec03e992-b1f0-4be8-baa4-c389c269769d taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.168146] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec03e992-b1f0-4be8-baa4-c389c269769d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.168204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec03e992-b1f0-4be8-baa4-c389c269769d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.168458] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec03e992-b1f0-4be8-baa4-c389c269769d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.168540] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec03e992-b1f0-4be8-baa4-c389c269769d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.671130] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec03e992-b1f0-4be8-baa4-c389c269769d [ 1287.671223] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.671384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.671454] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.671731] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.671840] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.671935] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec03e992-b1f0-4be8-baa4-c389c269769d already deleted. [ 1287.672204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec03e992-b1f0-4be8-baa4-c389c269769d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.022504] env[66834]: INFO networking_nsxv3.common.synchronization [req-0759daac-94a0-48f4-b6c0-d41c1890461b req-8bf72a47-9d4a-40e7-8b66-b7537535f7bd tempest-ServerAddressesNegativeTestJSON-209811894 tempest-ServerAddressesNegativeTestJSON-209811894-project-member] Enqueued Resource ID: d988bd9b-01f8-4a05-afd2-00c938df4bec with Priority: HIGHEST for action security_group_members [ 1290.023047] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d988bd9b-01f8-4a05-afd2-00c938df4bec with Priority: HIGHEST for action security_group_members [ 1290.023363] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-d988bd9b-01f8-4a05-afd2-00c938df4bec taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.023489] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.023555] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.023806] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.023965] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.024382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.024487] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.024606] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.024681] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.024781] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d988bd9b-01f8-4a05-afd2-00c938df4bec',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.328690] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-378 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.328896] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-378" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.329091] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-378" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.329454] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-378" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.329745] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.329965] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.330131] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.330387] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.330538] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.330744] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1290.330853] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1290.330958] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1290.331074] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1290.331181] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1290.331281] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1290.331417] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1290.352591] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1290.352746] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1290.352866] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1290.353055] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-378" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.353393] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-c3b84bff-00c7-42ee-93a4-df99398336cb taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.353578] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-c3b84bff-00c7-42ee-93a4-df99398336cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.353697] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-c3b84bff-00c7-42ee-93a4-df99398336cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.354039] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-c3b84bff-00c7-42ee-93a4-df99398336cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.354280] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3b84bff-00c7-42ee-93a4-df99398336cb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.527032] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.527266] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.527352] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.527505] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.527590] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.527788] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.527899] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.527962] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.528101] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.528169] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.528253] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d988bd9b-01f8-4a05-afd2-00c938df4bec already deleted. [ 1290.528387] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.857367] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.857590] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.857716] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.858026] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.858183] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.858339] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port c3b84bff-00c7-42ee-93a4-df99398336cb not found, creating... [ 1290.858601] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.858758] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.858873] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.859113] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.859251] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.859529] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.859684] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.859798] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.860009] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.860151] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.860288] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: c3b84bff-00c7-42ee-93a4-df99398336cb is going to be created. [ 1290.885787] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.886024] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.886123] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.886444] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.886694] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.886921] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-c3b84bff-00c7-42ee-93a4-df99398336cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.584476] env[66834]: INFO networking_nsxv3.common.synchronization [req-0759daac-94a0-48f4-b6c0-d41c1890461b req-d5a491a4-ad3a-4b31-bbbc-67ff992995dd service nova] Enqueued Resource ID: d988bd9b-01f8-4a05-afd2-00c938df4bec with Priority: HIGHEST for action security_group_rules [ 1291.584476] env[66834]: INFO networking_nsxv3.common.synchronization [req-0759daac-94a0-48f4-b6c0-d41c1890461b req-d5a491a4-ad3a-4b31-bbbc-67ff992995dd service nova] Enqueued Resource ID: d988bd9b-01f8-4a05-afd2-00c938df4bec with Priority: HIGHEST for action security_group_members [ 1291.584476] env[66834]: INFO networking_nsxv3.common.synchronization [req-0759daac-94a0-48f4-b6c0-d41c1890461b req-d5a491a4-ad3a-4b31-bbbc-67ff992995dd service nova] Enqueued Resource ID: c3b84bff-00c7-42ee-93a4-df99398336cb with Priority: HIGHEST for action port [ 1291.584476] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d988bd9b-01f8-4a05-afd2-00c938df4bec with Priority: HIGHEST for action security_group_rules [ 1291.584476] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d988bd9b-01f8-4a05-afd2-00c938df4bec with Priority: HIGHEST for action security_group_members [ 1291.584476] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3b84bff-00c7-42ee-93a4-df99398336cb with Priority: HIGHEST for action port [ 1291.584476] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d988bd9b-01f8-4a05-afd2-00c938df4bec taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.584954] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.584954] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.585109] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.585795] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d988bd9b-01f8-4a05-afd2-00c938df4bec',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.587395] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-d988bd9b-01f8-4a05-afd2-00c938df4bec taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.587527] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.587596] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.587772] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.587956] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.588073] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.588114] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.588260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.588345] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.588434] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d988bd9b-01f8-4a05-afd2-00c938df4bec',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.590198] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3b84bff-00c7-42ee-93a4-df99398336cb taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.590198] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3b84bff-00c7-42ee-93a4-df99398336cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.590198] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3b84bff-00c7-42ee-93a4-df99398336cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.590198] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3b84bff-00c7-42ee-93a4-df99398336cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.590198] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3b84bff-00c7-42ee-93a4-df99398336cb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.091608] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d988bd9b-01f8-4a05-afd2-00c938df4bec',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.092635] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-d988bd9b-01f8-4a05-afd2-00c938df4bec taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.093024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.093024] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3b84bff-00c7-42ee-93a4-df99398336cb with status ACTIVE [ 1292.093024] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.093222] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.093309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.093543] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.093652] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.093846] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.093972] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.094073] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.094310] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.094420] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.094610] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.094710] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.094812] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.094906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.095022] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.095067] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3b84bff-00c7-42ee-93a4-df99398336cb is going to be updated. [ 1292.119789] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.120032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.120032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.120218] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.120357] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.120511] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3b84bff-00c7-42ee-93a4-df99398336cb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.596958] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d988bd9b-01f8-4a05-afd2-00c938df4bec',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.099606] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.099606] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.099606] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.099606] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.099606] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.099978] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d988bd9b-01f8-4a05-afd2-00c938df4bec is going to be created. [ 1293.125074] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.125291] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.125342] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.125541] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.125705] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.134759] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d988bd9b-01f8-4a05-afd2-00c938df4bec in Status: UNINITIALIZED for 2s [ 1295.146052] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d988bd9b-01f8-4a05-afd2-00c938df4bec in Status: SUCCESS [ 1295.146382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.146382] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.146503] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.146694] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.146813] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.146876] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.147035] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.147117] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.147201] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.147292] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d988bd9b-01f8-4a05-afd2-00c938df4bec',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.650217] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-d988bd9b-01f8-4a05-afd2-00c938df4bec taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.650444] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.650444] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.650607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.650773] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.650879] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.650946] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.651118] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.651204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.651295] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.651446] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-d988bd9b-01f8-4a05-afd2-00c938df4bec taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.651541] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.651603] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.651745] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.651879] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.651971] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.652045] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.652200] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.652292] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.652358] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.652447] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d988bd9b-01f8-4a05-afd2-00c938df4bec',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.154708] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d988bd9b-01f8-4a05-afd2-00c938df4bec: rpc.has_security_group_logging(os_id): False [ 1296.172457] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.172622] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.172622] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.172804] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.172892] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.173124] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.173252] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.173344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.173531] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.173611] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.173790] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.173909] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.173972] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.174134] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.174208] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.174420] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.174518] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.174570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.174711] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.174780] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.174863] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d988bd9b-01f8-4a05-afd2-00c938df4bec is going to be created. [ 1296.230049] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.230240] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.230282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.230485] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.230678] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.243976] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d988bd9b-01f8-4a05-afd2-00c938df4bec in Status: IN_PROGRESS for 2s [ 1296.584804] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1296.585025] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1298.258122] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d988bd9b-01f8-4a05-afd2-00c938df4bec in Status: SUCCESS [ 1298.258459] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.058910] env[66834]: INFO networking_nsxv3.common.synchronization [req-cc09cbd5-495a-4aa5-b270-5ca932d29bf8 req-465b3287-5c3c-4920-9fe1-8dfac8efafb8 tempest-ServerAddressesNegativeTestJSON-209811894 tempest-ServerAddressesNegativeTestJSON-209811894-project-member] Enqueued Resource ID: d988bd9b-01f8-4a05-afd2-00c938df4bec with Priority: HIGHEST for action security_group_members [ 1301.059776] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d988bd9b-01f8-4a05-afd2-00c938df4bec with Priority: HIGHEST for action security_group_members [ 1301.059776] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-d988bd9b-01f8-4a05-afd2-00c938df4bec taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.059776] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.059776] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.060051] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.060089] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.060177] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.060276] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.060419] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.060498] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.060544] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d988bd9b-01f8-4a05-afd2-00c938df4bec',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.563772] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.563932] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.564012] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.564252] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.564387] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.564575] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.564670] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.564733] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.564886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.564964] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.565062] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d988bd9b-01f8-4a05-afd2-00c938df4bec is going to be updated. [ 1301.597245] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.597442] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.597485] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.597662] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.597804] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.606870] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d988bd9b-01f8-4a05-afd2-00c938df4bec in Status: IN_PROGRESS for 2s [ 1303.619696] env[66834]: INFO networking_nsxv3.common.synchronization [req-6e279c62-a4d4-4e0d-8e28-c52bb80631ac req-f00da112-06e3-448d-b8e5-bc24a5d12c1f tempest-ServerRescueNegativeTestJSON-599514552 tempest-ServerRescueNegativeTestJSON-599514552-project-member] Enqueued Resource ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 with Priority: HIGHEST for action security_group_members [ 1303.620675] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d988bd9b-01f8-4a05-afd2-00c938df4bec in Status: SUCCESS [ 1303.620965] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d988bd9b-01f8-4a05-afd2-00c938df4bec deletion is rescheduled due to dependency. [ 1303.621068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.621483] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 with Priority: HIGHEST for action security_group_members [ 1303.622081] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.622081] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.622081] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.622448] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.622448] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.622448] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.622572] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.622813] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.622813] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.622908] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aae6a6e9-1f82-4e25-9279-c0d1c3b5b593',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.126587] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.126776] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.126956] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.127193] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.127295] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.127500] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.127601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.127665] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.127817] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.127892] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.127978] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 is going to be updated. [ 1304.155184] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.155388] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.155388] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.155583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.155735] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.164854] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 in Status: IN_PROGRESS for 2s [ 1306.176813] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 in Status: SUCCESS [ 1306.177203] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aae6a6e9-1f82-4e25-9279-c0d1c3b5b593 deletion is rescheduled due to dependency. [ 1306.177203] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aae6a6e9-1f82-4e25-9279-c0d1c3b5b593" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.622438] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1308.622905] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1308.917105] env[66834]: INFO networking_nsxv3.common.synchronization [None req-14e04c42-a000-4231-a0d1-a8de0593f70b None None] Enqueued Resource ID: aae9739e-5cb2-4370-8e2e-c3d8c5c7d610 with Priority: HIGHEST for action port [ 1308.917371] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aae9739e-5cb2-4370-8e2e-c3d8c5c7d610 with Priority: HIGHEST for action port [ 1308.917987] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-aae9739e-5cb2-4370-8e2e-c3d8c5c7d610 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.918119] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aae9739e-5cb2-4370-8e2e-c3d8c5c7d610" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.918208] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aae9739e-5cb2-4370-8e2e-c3d8c5c7d610" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.918452] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aae9739e-5cb2-4370-8e2e-c3d8c5c7d610" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.918554] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aae9739e-5cb2-4370-8e2e-c3d8c5c7d610',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.423068] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aae9739e-5cb2-4370-8e2e-c3d8c5c7d610 [ 1309.423068] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.423068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.423068] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.423369] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.423369] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.423433] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aae9739e-5cb2-4370-8e2e-c3d8c5c7d610 already deleted. [ 1309.423477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aae9739e-5cb2-4370-8e2e-c3d8c5c7d610" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.049855] env[66834]: INFO networking_nsxv3.common.synchronization [None req-9753d424-39d7-454e-b8c1-29e70df9dcfc None None] Enqueued Resource ID: e8acc980-ee00-476f-8cf0-c2b4bd65a075 with Priority: HIGHEST for action port [ 1311.050387] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8acc980-ee00-476f-8cf0-c2b4bd65a075 with Priority: HIGHEST for action port [ 1311.050685] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8acc980-ee00-476f-8cf0-c2b4bd65a075 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.050808] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8acc980-ee00-476f-8cf0-c2b4bd65a075" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.050876] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8acc980-ee00-476f-8cf0-c2b4bd65a075" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.051139] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8acc980-ee00-476f-8cf0-c2b4bd65a075" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.051220] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8acc980-ee00-476f-8cf0-c2b4bd65a075',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.552733] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e8acc980-ee00-476f-8cf0-c2b4bd65a075 [ 1311.552975] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.553122] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.553194] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.553399] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.553485] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.553579] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e8acc980-ee00-476f-8cf0-c2b4bd65a075 already deleted. [ 1311.553661] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8acc980-ee00-476f-8cf0-c2b4bd65a075" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.360370] env[66834]: INFO networking_nsxv3.common.synchronization [req-293c9d97-49c3-4217-87c1-7d92dc8737b3 req-e40f96f3-ddc3-433b-876b-e29d6833349a tempest-ServerMetadataNegativeTestJSON-1167465192 tempest-ServerMetadataNegativeTestJSON-1167465192-project-member] Enqueued Resource ID: 50181de0-6504-4170-88de-c63c6b1ec2d0 with Priority: HIGHEST for action security_group_members [ 1314.360663] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50181de0-6504-4170-88de-c63c6b1ec2d0 with Priority: HIGHEST for action security_group_members [ 1314.360880] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-50181de0-6504-4170-88de-c63c6b1ec2d0 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.361026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.361072] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.361320] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.361479] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.361574] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.361631] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.361779] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.361866] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.361959] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50181de0-6504-4170-88de-c63c6b1ec2d0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.648762] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-224 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.648985] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-224" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.649080] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-224" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.649422] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-224" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.649685] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.649842] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.649958] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.650200] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.650338] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.650546] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1314.650659] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1314.650767] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1314.650872] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1314.650980] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1314.651096] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1314.651225] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1314.673460] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1314.673657] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1314.673746] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1314.673926] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-224" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.674275] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-5c29c0cf-fa20-47bf-bdb0-f92c27da5a20 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.674501] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-5c29c0cf-fa20-47bf-bdb0-f92c27da5a20" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.674599] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-5c29c0cf-fa20-47bf-bdb0-f92c27da5a20" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.674944] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-5c29c0cf-fa20-47bf-bdb0-f92c27da5a20" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.675097] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c29c0cf-fa20-47bf-bdb0-f92c27da5a20',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.864512] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.864784] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.864864] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.865088] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.865181] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.865378] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.865472] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.865532] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.866069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.866069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.866069] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50181de0-6504-4170-88de-c63c6b1ec2d0 already deleted. [ 1314.866069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.178048] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.178277] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.178356] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.178634] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.178787] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.179015] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Segment Port 5c29c0cf-fa20-47bf-bdb0-f92c27da5a20 not found, creating... [ 1315.179309] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.179537] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.179609] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.179806] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.179943] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.180248] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.180495] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.180616] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.180847] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.180984] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.181126] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 5c29c0cf-fa20-47bf-bdb0-f92c27da5a20 is going to be created. [ 1315.226829] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.227042] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.227782] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.227782] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.228052] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.228198] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-5c29c0cf-fa20-47bf-bdb0-f92c27da5a20" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.235684] env[66834]: INFO networking_nsxv3.common.synchronization [req-084ccbc1-a54e-4e59-981b-c6cc454fa932 req-18c94cb0-b009-4e65-9b86-4c9f1dcbbb5b tempest-ServerRescueNegativeTestJSON-599514552 tempest-ServerRescueNegativeTestJSON-599514552-project-member] Enqueued Resource ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 with Priority: HIGHEST for action security_group_members [ 1315.236250] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 with Priority: HIGHEST for action security_group_members [ 1315.237031] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-52cb0804-8dc9-431c-b223-368ab8a8eb18 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.237031] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.237031] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.237031] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.237268] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.237268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.237343] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.237908] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.237908] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.237908] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52cb0804-8dc9-431c-b223-368ab8a8eb18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.739939] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52cb0804-8dc9-431c-b223-368ab8a8eb18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.895028] env[66834]: INFO networking_nsxv3.common.synchronization [req-293c9d97-49c3-4217-87c1-7d92dc8737b3 req-f5e2aee1-8b94-4987-8c26-7b0819dbe7f4 service nova] Enqueued Resource ID: 50181de0-6504-4170-88de-c63c6b1ec2d0 with Priority: HIGHEST for action security_group_rules [ 1315.895221] env[66834]: INFO networking_nsxv3.common.synchronization [req-293c9d97-49c3-4217-87c1-7d92dc8737b3 req-f5e2aee1-8b94-4987-8c26-7b0819dbe7f4 service nova] Enqueued Resource ID: 50181de0-6504-4170-88de-c63c6b1ec2d0 with Priority: HIGHEST for action security_group_members [ 1315.895354] env[66834]: INFO networking_nsxv3.common.synchronization [req-293c9d97-49c3-4217-87c1-7d92dc8737b3 req-f5e2aee1-8b94-4987-8c26-7b0819dbe7f4 service nova] Enqueued Resource ID: 5c29c0cf-fa20-47bf-bdb0-f92c27da5a20 with Priority: HIGHEST for action port [ 1315.896185] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50181de0-6504-4170-88de-c63c6b1ec2d0 with Priority: HIGHEST for action security_group_rules [ 1315.896320] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50181de0-6504-4170-88de-c63c6b1ec2d0 with Priority: HIGHEST for action security_group_members [ 1315.896416] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c29c0cf-fa20-47bf-bdb0-f92c27da5a20 with Priority: HIGHEST for action port [ 1315.896684] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50181de0-6504-4170-88de-c63c6b1ec2d0 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.896835] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.896911] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.897303] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.897393] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50181de0-6504-4170-88de-c63c6b1ec2d0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.898563] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-50181de0-6504-4170-88de-c63c6b1ec2d0 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.898652] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.898803] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.898988] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.899153] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.899258] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.899344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.899456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.899537] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.899640] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50181de0-6504-4170-88de-c63c6b1ec2d0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.901020] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c29c0cf-fa20-47bf-bdb0-f92c27da5a20 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.901385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c29c0cf-fa20-47bf-bdb0-f92c27da5a20" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.901385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c29c0cf-fa20-47bf-bdb0-f92c27da5a20" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.901481] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c29c0cf-fa20-47bf-bdb0-f92c27da5a20" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.901531] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c29c0cf-fa20-47bf-bdb0-f92c27da5a20',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.242569] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52cb0804-8dc9-431c-b223-368ab8a8eb18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.403362] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c29c0cf-fa20-47bf-bdb0-f92c27da5a20 with status ACTIVE [ 1316.403603] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.403774] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.403903] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.404034] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.404121] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.404298] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.404402] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.404496] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.404687] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.404749] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.404931] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.405042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.405097] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.405238] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.405311] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.405393] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c29c0cf-fa20-47bf-bdb0-f92c27da5a20 is going to be updated. [ 1316.406528] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-50181de0-6504-4170-88de-c63c6b1ec2d0 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.406647] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.406787] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50181de0-6504-4170-88de-c63c6b1ec2d0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.426745] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.426966] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.427042] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.427237] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.427370] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.427525] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c29c0cf-fa20-47bf-bdb0-f92c27da5a20" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.745329] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.745643] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.745643] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.745779] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.745886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.745975] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 is going to be updated. [ 1316.774515] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.774712] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.774774] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.775019] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.775098] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.785026] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 in Status: IN_PROGRESS for 2s [ 1316.909137] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50181de0-6504-4170-88de-c63c6b1ec2d0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.411589] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.411932] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.411932] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.412125] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.412219] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.412333] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50181de0-6504-4170-88de-c63c6b1ec2d0 is going to be created. [ 1317.447740] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.448119] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.448421] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.448802] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.449127] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.463578] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50181de0-6504-4170-88de-c63c6b1ec2d0 in Status: UNINITIALIZED for 2s [ 1318.794587] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 in Status: SUCCESS [ 1318.794967] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.476203] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50181de0-6504-4170-88de-c63c6b1ec2d0 in Status: SUCCESS [ 1319.476440] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.476613] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.476862] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.477148] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.477285] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.477353] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.477566] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.477695] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.477776] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.477866] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50181de0-6504-4170-88de-c63c6b1ec2d0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.980342] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-50181de0-6504-4170-88de-c63c6b1ec2d0 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.980680] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.980680] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.980771] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.981886] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.981886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.981886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.981886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.981886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.981886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.981886] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-50181de0-6504-4170-88de-c63c6b1ec2d0 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.981886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.981886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.981886] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.982299] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.982299] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.982299] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.982299] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.982437] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.982437] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.982614] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50181de0-6504-4170-88de-c63c6b1ec2d0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.485354] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50181de0-6504-4170-88de-c63c6b1ec2d0: rpc.has_security_group_logging(os_id): False [ 1320.503541] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.503814] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.503814] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.503975] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.504139] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.504243] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.504347] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.504410] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.504570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.504674] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.504800] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.504920] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.505032] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.505158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.505229] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.505419] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.505514] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.505586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.505705] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.505778] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.505862] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50181de0-6504-4170-88de-c63c6b1ec2d0 is going to be created. [ 1320.568149] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.568408] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.568408] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.568564] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.568740] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.580495] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50181de0-6504-4170-88de-c63c6b1ec2d0 in Status: IN_PROGRESS for 2s [ 1320.897764] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1320.897867] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1322.594626] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50181de0-6504-4170-88de-c63c6b1ec2d0 in Status: SUCCESS [ 1322.594922] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.902235] env[66834]: INFO networking_nsxv3.common.synchronization [req-dedb356d-9e35-4dd2-8d04-1fa785449ab1 req-c3808fb3-1713-4a45-91c6-bc65c70d482f tempest-ServerActionsV293TestJSON-582429360 tempest-ServerActionsV293TestJSON-582429360-project-member] Enqueued Resource ID: 849b7083-c8aa-4040-9084-38d57e44aa72 with Priority: HIGHEST for action security_group_members [ 1323.902915] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 849b7083-c8aa-4040-9084-38d57e44aa72 with Priority: HIGHEST for action security_group_members [ 1323.903132] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-849b7083-c8aa-4040-9084-38d57e44aa72 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.903756] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.903756] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.903756] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.903756] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.903756] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.904015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.904015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.904015] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.904116] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('849b7083-c8aa-4040-9084-38d57e44aa72',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.407487] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.407648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.407648] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.408350] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.408350] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.408350] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.408350] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.408350] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.408569] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.408606] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.408793] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 849b7083-c8aa-4040-9084-38d57e44aa72 is going to be updated. [ 1324.437317] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.437475] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.437523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.437720] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.437860] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.447799] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 849b7083-c8aa-4040-9084-38d57e44aa72 in Status: IN_PROGRESS for 2s [ 1324.454795] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.455149] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "network-557" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.455473] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "network-557" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.455943] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "network-557" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.456244] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.456433] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.456542] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.456797] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.456966] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.457214] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1324.457330] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1324.457445] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1324.457553] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1324.457679] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1324.457782] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1324.457930] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1324.476689] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1324.476883] env[66834]: DEBUG dogpile.cache.region [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1324.477010] env[66834]: DEBUG dogpile.lock [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1324.477205] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "network-557" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.477540] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock port-7b747d01-d674-45d2-85d2-dc1b1c53cadb taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.477725] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "port-7b747d01-d674-45d2-85d2-dc1b1c53cadb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.477847] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "port-7b747d01-d674-45d2-85d2-dc1b1c53cadb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.478150] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "port-7b747d01-d674-45d2-85d2-dc1b1c53cadb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.478290] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b747d01-d674-45d2-85d2-dc1b1c53cadb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.980289] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.980656] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.980656] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.980894] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.981053] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.981337] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.981487] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.981600] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.981814] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.981976] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.982280] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.982439] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.982586] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.982797] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.982925] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.983080] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Resource: SegmentPort with ID: 7b747d01-d674-45d2-85d2-dc1b1c53cadb is going to be updated. [ 1325.004390] env[66834]: DEBUG networking_nsxv3.common.locking [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.004729] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.004876] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.005158] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.005348] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.005628] env[66834]: DEBUG oslo_concurrency.lockutils [None req-a600c51f-717f-44ec-b797-94474b033da6 None None] Releasing lock "port-7b747d01-d674-45d2-85d2-dc1b1c53cadb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.503730] env[66834]: INFO networking_nsxv3.common.synchronization [req-a681d6ba-b279-4381-bf48-474898622587 req-a0d6c2b2-e2c8-4c7c-bfff-d9e7b2f13cc6 tempest-ServerRescueNegativeTestJSON-599514552 tempest-ServerRescueNegativeTestJSON-599514552-project-member] Enqueued Resource ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 with Priority: HIGHEST for action security_group_members [ 1325.503730] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 with Priority: HIGHEST for action security_group_members [ 1325.504013] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-52cb0804-8dc9-431c-b223-368ab8a8eb18 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.504156] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.504224] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.504424] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.504633] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.504757] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.504906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.505175] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.505175] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.505175] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52cb0804-8dc9-431c-b223-368ab8a8eb18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.739261] env[66834]: INFO networking_nsxv3.common.synchronization [req-7dddf34c-7510-4807-a526-3382bc5dabc8 req-1b662ee5-0954-4ef3-9860-b1c147220d69 service nova] Enqueued Resource ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f with Priority: HIGHEST for action security_group_rules [ 1325.739427] env[66834]: INFO networking_nsxv3.common.synchronization [req-7dddf34c-7510-4807-a526-3382bc5dabc8 req-1b662ee5-0954-4ef3-9860-b1c147220d69 service nova] Enqueued Resource ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f with Priority: HIGHEST for action security_group_members [ 1325.739561] env[66834]: INFO networking_nsxv3.common.synchronization [req-7dddf34c-7510-4807-a526-3382bc5dabc8 req-1b662ee5-0954-4ef3-9860-b1c147220d69 service nova] Enqueued Resource ID: 7b747d01-d674-45d2-85d2-dc1b1c53cadb with Priority: HIGHEST for action port [ 1325.739784] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f with Priority: HIGHEST for action security_group_rules [ 1325.739911] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f with Priority: HIGHEST for action security_group_members [ 1325.740010] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b747d01-d674-45d2-85d2-dc1b1c53cadb with Priority: HIGHEST for action port [ 1325.740543] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb96d654-f9e7-43ce-b22e-df261ce3be7f taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.740668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.740736] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.740929] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.741020] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb96d654-f9e7-43ce-b22e-df261ce3be7f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.742731] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb96d654-f9e7-43ce-b22e-df261ce3be7f taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.743447] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.743447] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.743447] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.743447] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.743447] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.743447] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.743715] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.743715] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.743715] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb96d654-f9e7-43ce-b22e-df261ce3be7f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.747332] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b747d01-d674-45d2-85d2-dc1b1c53cadb taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.747332] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b747d01-d674-45d2-85d2-dc1b1c53cadb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.747332] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b747d01-d674-45d2-85d2-dc1b1c53cadb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.747332] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b747d01-d674-45d2-85d2-dc1b1c53cadb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.747332] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b747d01-d674-45d2-85d2-dc1b1c53cadb',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.900784] env[66834]: INFO networking_nsxv3.common.synchronization [req-05d57558-c52a-40db-9933-3413d79134c1 req-fe21befa-ae23-4fb0-bb2e-9884ff29ea49 tempest-ServerMetadataNegativeTestJSON-1167465192 tempest-ServerMetadataNegativeTestJSON-1167465192-project-member] Enqueued Resource ID: 50181de0-6504-4170-88de-c63c6b1ec2d0 with Priority: HIGHEST for action security_group_members [ 1325.901688] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50181de0-6504-4170-88de-c63c6b1ec2d0 with Priority: HIGHEST for action security_group_members [ 1325.901688] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-50181de0-6504-4170-88de-c63c6b1ec2d0 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.901890] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.901890] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.902079] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.902231] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.902329] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.902388] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.902599] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.902722] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.902722] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50181de0-6504-4170-88de-c63c6b1ec2d0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.009643] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.009977] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.010599] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.011268] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.011427] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.011742] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.011908] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.012034] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.012295] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.012427] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.013055] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 is going to be updated. [ 1326.043240] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.043694] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.044245] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.044245] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.044438] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.054460] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 in Status: IN_PROGRESS for 2s [ 1326.243078] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb96d654-f9e7-43ce-b22e-df261ce3be7f taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.243261] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.245620] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb96d654-f9e7-43ce-b22e-df261ce3be7f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.248735] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b747d01-d674-45d2-85d2-dc1b1c53cadb with status ACTIVE [ 1326.248860] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.248972] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.249177] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.249901] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.249901] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.249901] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.249901] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.249901] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.249901] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.249901] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.250224] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.250224] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.250224] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.250345] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.250345] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.250857] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b747d01-d674-45d2-85d2-dc1b1c53cadb is going to be updated. [ 1326.275670] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.275905] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.275984] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.276158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.276295] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.276548] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b747d01-d674-45d2-85d2-dc1b1c53cadb" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.406403] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.406403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.406403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.406403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.406403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.406403] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.406403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.406403] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.406984] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.406984] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.406984] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50181de0-6504-4170-88de-c63c6b1ec2d0 is going to be updated. [ 1326.445593] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.445683] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.445724] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.445917] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.446067] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.457381] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50181de0-6504-4170-88de-c63c6b1ec2d0 in Status: IN_PROGRESS for 2s [ 1326.464929] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 849b7083-c8aa-4040-9084-38d57e44aa72 in Status: SUCCESS [ 1326.465129] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 849b7083-c8aa-4040-9084-38d57e44aa72 deletion is rescheduled due to dependency. [ 1326.465244] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.749415] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb96d654-f9e7-43ce-b22e-df261ce3be7f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.252553] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.256384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.256384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.256384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.256384] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.256384] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f is going to be updated. [ 1327.288019] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.288232] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.288308] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.288523] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.288669] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.298277] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f in Status: IN_PROGRESS for 2s [ 1328.064969] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 in Status: SUCCESS [ 1328.065167] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 deletion is rescheduled due to dependency. [ 1328.065282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.468990] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50181de0-6504-4170-88de-c63c6b1ec2d0 in Status: SUCCESS [ 1328.469346] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50181de0-6504-4170-88de-c63c6b1ec2d0 deletion is rescheduled due to dependency. [ 1328.469346] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.310313] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f in Status: SUCCESS [ 1329.310553] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.310726] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.310956] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.311165] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.311283] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.311346] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.311495] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.311572] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.311651] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.311740] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb96d654-f9e7-43ce-b22e-df261ce3be7f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.813859] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb96d654-f9e7-43ce-b22e-df261ce3be7f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.317175] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb96d654-f9e7-43ce-b22e-df261ce3be7f: rpc.has_security_group_logging(os_id): False [ 1330.336377] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.336601] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.336727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.337020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.356698] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.357527] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.357883] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.358084] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.358474] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.358633] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.358863] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f is going to be updated. [ 1330.421942] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.421942] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.421942] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.421942] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.421942] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.437564] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f in Status: IN_PROGRESS for 2s [ 1330.902025] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1330.902290] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1332.457239] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f in Status: SUCCESS [ 1332.457587] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.756781] env[66834]: INFO networking_nsxv3.common.synchronization [None req-47ff3e17-495a-4c44-b4fc-2d7a591b84dd None None] Enqueued Resource ID: 14eaab97-7b3a-45b0-bc40-fbb9ba236813 with Priority: HIGHEST for action port [ 1333.757511] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14eaab97-7b3a-45b0-bc40-fbb9ba236813 with Priority: HIGHEST for action port [ 1333.757832] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-14eaab97-7b3a-45b0-bc40-fbb9ba236813 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.757999] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14eaab97-7b3a-45b0-bc40-fbb9ba236813" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.758108] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14eaab97-7b3a-45b0-bc40-fbb9ba236813" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.758385] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14eaab97-7b3a-45b0-bc40-fbb9ba236813" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.758495] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14eaab97-7b3a-45b0-bc40-fbb9ba236813',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.260648] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14eaab97-7b3a-45b0-bc40-fbb9ba236813 [ 1334.260888] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.261039] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.261125] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.261329] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.261414] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.261505] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14eaab97-7b3a-45b0-bc40-fbb9ba236813 already deleted. [ 1334.261584] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14eaab97-7b3a-45b0-bc40-fbb9ba236813" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.275533] env[66834]: INFO networking_nsxv3.common.synchronization [None req-b0ac2815-04f4-45ac-865a-4b1cd3b02dd6 tempest-AttachVolumeTestJSON-1058476096 tempest-AttachVolumeTestJSON-1058476096-project-member] Enqueued Resource ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a with Priority: HIGHEST for action security_group_rules [ 1334.275851] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a with Priority: HIGHEST for action security_group_rules [ 1334.277231] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e596c06-a8da-4399-84d9-6ac9ccab328a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.277231] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.277231] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.277231] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.277231] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e596c06-a8da-4399-84d9-6ac9ccab328a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.396902] env[66834]: INFO networking_nsxv3.common.synchronization [None req-25890092-2689-4daa-967d-af422f396f0d tempest-AttachVolumeTestJSON-1058476096 tempest-AttachVolumeTestJSON-1058476096-project-member] Enqueued Resource ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a with Priority: HIGHEST for action security_group_rules [ 1334.397574] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a with Priority: HIGHEST for action security_group_rules [ 1334.397574] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e596c06-a8da-4399-84d9-6ac9ccab328a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.397721] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.802779] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.803184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.803184] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.803389] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.803447] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.803549] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a already deleted. [ 1334.803639] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.803800] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.803967] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.804090] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e596c06-a8da-4399-84d9-6ac9ccab328a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.333410] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.333612] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.333663] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.334377] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.334377] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.334377] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a already deleted. [ 1335.334377] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.924303] env[66834]: INFO networking_nsxv3.common.synchronization [None req-73ee1606-e0a0-4cf7-8483-362acf18af86 None None] Enqueued Resource ID: 9a1678b7-6d12-4034-8cba-7cc2a1d698c4 with Priority: HIGHEST for action port [ 1335.924588] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a1678b7-6d12-4034-8cba-7cc2a1d698c4 with Priority: HIGHEST for action port [ 1335.924789] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a1678b7-6d12-4034-8cba-7cc2a1d698c4 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.925624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a1678b7-6d12-4034-8cba-7cc2a1d698c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.925624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a1678b7-6d12-4034-8cba-7cc2a1d698c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.925624] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a1678b7-6d12-4034-8cba-7cc2a1d698c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.925624] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a1678b7-6d12-4034-8cba-7cc2a1d698c4',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.428153] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a1678b7-6d12-4034-8cba-7cc2a1d698c4 [ 1336.428447] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.428537] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.428683] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.428820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.428927] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.429051] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a1678b7-6d12-4034-8cba-7cc2a1d698c4 already deleted. [ 1336.429156] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a1678b7-6d12-4034-8cba-7cc2a1d698c4" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.492735] env[66834]: INFO networking_nsxv3.common.synchronization [req-329e1781-e93a-4210-8c8e-ccd3a8ee74a9 req-4647604b-9ea1-4375-893c-13d826b83023 tempest-AttachVolumeTestJSON-1058476096 tempest-AttachVolumeTestJSON-1058476096-project-member] Enqueued Resource ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a with Priority: HIGHEST for action security_group_members [ 1340.493286] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a with Priority: HIGHEST for action security_group_members [ 1340.493554] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e596c06-a8da-4399-84d9-6ac9ccab328a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.493692] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.493755] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.493989] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.494165] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.494260] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.494318] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.494465] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.494542] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.494631] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e596c06-a8da-4399-84d9-6ac9ccab328a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.780849] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-334 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.781177] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-334" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.781270] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-334" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.781736] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-334" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.781842] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.782061] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.782205] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.782515] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.782592] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.782852] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1340.782999] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1340.783157] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1340.783350] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1340.783350] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1340.783468] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1340.783677] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1340.804181] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1340.804422] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1340.804543] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1340.804804] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-334" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.805309] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-343cb9d1-d96b-4d6f-ae54-5369c5c4410e taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.805554] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-343cb9d1-d96b-4d6f-ae54-5369c5c4410e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.805801] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-343cb9d1-d96b-4d6f-ae54-5369c5c4410e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.806187] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-343cb9d1-d96b-4d6f-ae54-5369c5c4410e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.806365] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('343cb9d1-d96b-4d6f-ae54-5369c5c4410e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.996941] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.997117] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.997204] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.997391] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.997476] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.997664] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.997768] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.997834] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.997954] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.998038] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.998121] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a already deleted. [ 1340.998199] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.308593] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.308841] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.308956] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.309296] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.309451] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.309608] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port 343cb9d1-d96b-4d6f-ae54-5369c5c4410e not found, creating... [ 1341.309867] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.310203] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.310379] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.310598] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.310731] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.311021] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.311179] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.311291] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.311493] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.312018] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.312018] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: 343cb9d1-d96b-4d6f-ae54-5369c5c4410e is going to be created. [ 1341.331282] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.331484] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.331578] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.331815] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.332047] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.332263] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-343cb9d1-d96b-4d6f-ae54-5369c5c4410e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.016312] env[66834]: INFO networking_nsxv3.common.synchronization [req-329e1781-e93a-4210-8c8e-ccd3a8ee74a9 req-8fa51d32-c268-4b89-80ec-4dd1bca4c8a1 service nova] Enqueued Resource ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a with Priority: HIGHEST for action security_group_rules [ 1342.016625] env[66834]: INFO networking_nsxv3.common.synchronization [req-329e1781-e93a-4210-8c8e-ccd3a8ee74a9 req-8fa51d32-c268-4b89-80ec-4dd1bca4c8a1 service nova] Enqueued Resource ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a with Priority: HIGHEST for action security_group_members [ 1342.016779] env[66834]: INFO networking_nsxv3.common.synchronization [req-329e1781-e93a-4210-8c8e-ccd3a8ee74a9 req-8fa51d32-c268-4b89-80ec-4dd1bca4c8a1 service nova] Enqueued Resource ID: 343cb9d1-d96b-4d6f-ae54-5369c5c4410e with Priority: HIGHEST for action port [ 1342.017179] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a with Priority: HIGHEST for action security_group_rules [ 1342.017316] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a with Priority: HIGHEST for action security_group_members [ 1342.017413] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 343cb9d1-d96b-4d6f-ae54-5369c5c4410e with Priority: HIGHEST for action port [ 1342.017682] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e596c06-a8da-4399-84d9-6ac9ccab328a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.017803] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.017871] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.018079] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.018159] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e596c06-a8da-4399-84d9-6ac9ccab328a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.018986] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e596c06-a8da-4399-84d9-6ac9ccab328a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.019113] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.019180] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.019340] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.019481] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.019572] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.019630] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.019764] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.019846] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.019977] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e596c06-a8da-4399-84d9-6ac9ccab328a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.020677] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-343cb9d1-d96b-4d6f-ae54-5369c5c4410e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.020785] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-343cb9d1-d96b-4d6f-ae54-5369c5c4410e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.020855] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-343cb9d1-d96b-4d6f-ae54-5369c5c4410e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.020989] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-343cb9d1-d96b-4d6f-ae54-5369c5c4410e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.021079] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('343cb9d1-d96b-4d6f-ae54-5369c5c4410e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.522939] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e596c06-a8da-4399-84d9-6ac9ccab328a taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.523187] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.523246] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e596c06-a8da-4399-84d9-6ac9ccab328a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.524308] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 343cb9d1-d96b-4d6f-ae54-5369c5c4410e with status ACTIVE [ 1342.524489] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.524608] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.524691] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.524961] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.525110] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.525250] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.525350] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.525414] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.525574] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.525652] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.525837] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.525938] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.526069] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.526198] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.526282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.526368] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 343cb9d1-d96b-4d6f-ae54-5369c5c4410e is going to be updated. [ 1342.546554] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.546747] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.546747] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.546947] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.547098] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.547253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-343cb9d1-d96b-4d6f-ae54-5369c5c4410e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.028591] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e596c06-a8da-4399-84d9-6ac9ccab328a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.531536] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.531792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.531792] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.532053] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.532147] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.532265] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a is going to be created. [ 1343.560344] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.560565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.560565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.560814] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.560998] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.570926] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a in Status: UNINITIALIZED for 2s [ 1345.582027] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a in Status: SUCCESS [ 1345.582375] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.582720] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.582914] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.583154] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.583273] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.583339] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.583500] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.583583] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.583668] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.583757] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e596c06-a8da-4399-84d9-6ac9ccab328a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.086132] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e596c06-a8da-4399-84d9-6ac9ccab328a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.589058] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e596c06-a8da-4399-84d9-6ac9ccab328a: rpc.has_security_group_logging(os_id): False [ 1346.606388] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.606607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.606607] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.606798] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.606892] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.607148] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.607253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.607315] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.607467] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.607543] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.607628] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a is going to be created. [ 1346.662702] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.662919] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.662919] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.663078] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.663239] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.674017] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a in Status: IN_PROGRESS for 2s [ 1347.019193] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1347.019377] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1348.686838] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a in Status: SUCCESS [ 1348.687202] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.020362] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1352.020756] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1357.021392] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1357.021835] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1362.022638] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1362.023084] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1367.024371] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1367.024739] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1372.025858] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1372.025858] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1376.529950] env[66834]: INFO networking_nsxv3.common.synchronization [req-6682d67e-9732-406c-aeec-f195c1ed06d2 req-a3ad7210-bb7d-406f-bbd6-be9e23c2509a tempest-AttachVolumeShelveTestJSON-172859501 tempest-AttachVolumeShelveTestJSON-172859501-project-member] Enqueued Resource ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f with Priority: HIGHEST for action security_group_members [ 1376.530588] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f with Priority: HIGHEST for action security_group_members [ 1376.530949] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb96d654-f9e7-43ce-b22e-df261ce3be7f taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.531097] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.531169] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.531367] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.531753] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.531753] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.531753] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.532089] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.532089] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.532089] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb96d654-f9e7-43ce-b22e-df261ce3be7f',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.034442] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.034672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.034672] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.034816] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.034906] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.035140] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.035240] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.035309] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.035461] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.035536] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.035625] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f is going to be updated. [ 1377.064234] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.064468] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.064468] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.064679] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.064822] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.075645] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f in Status: IN_PROGRESS for 2s [ 1379.086574] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f in Status: SUCCESS [ 1379.086970] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb96d654-f9e7-43ce-b22e-df261ce3be7f deletion is rescheduled due to dependency. [ 1379.086970] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb96d654-f9e7-43ce-b22e-df261ce3be7f" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.531446] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1381.531822] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1386.532125] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1386.532483] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1391.534061] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1391.534061] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1396.535119] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1396.535569] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1401.535974] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1401.536394] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1406.536756] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1406.536756] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1411.538283] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1411.538725] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1416.539342] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1416.539342] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1421.540574] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1421.540574] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1426.541385] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1426.541385] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1431.542257] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1431.542661] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1436.542916] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1436.542916] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1441.544055] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1441.544055] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1446.545414] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1446.545828] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1451.546651] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1451.547135] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1456.547810] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1456.548300] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1461.549499] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1461.549499] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1466.550797] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1466.551173] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1471.552041] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1471.552443] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1476.553048] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1476.553533] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1481.554128] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1481.554532] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1482.948793] env[66834]: INFO networking_nsxv3.common.synchronization [req-b4d33e7f-05f1-499a-bb2d-d0320dca0f0b req-d5f041fc-72d3-483c-87cc-e6418b5313ef tempest-AttachVolumeTestJSON-1058476096 tempest-AttachVolumeTestJSON-1058476096-project-member] Enqueued Resource ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a with Priority: HIGHEST for action security_group_members [ 1482.949370] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a with Priority: HIGHEST for action security_group_members [ 1482.949693] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e596c06-a8da-4399-84d9-6ac9ccab328a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.949816] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.949880] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.950171] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.950264] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.950377] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.950448] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.950565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.950656] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.950746] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e596c06-a8da-4399-84d9-6ac9ccab328a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.452822] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.453139] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.453139] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.453280] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.453332] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.453501] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.453605] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.453659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.453809] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.453883] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.453976] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a is going to be updated. [ 1483.493793] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.494111] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.494111] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.494247] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.494389] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.504236] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a in Status: IN_PROGRESS for 2s [ 1485.515849] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a in Status: SUCCESS [ 1485.516281] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a deletion is rescheduled due to dependency. [ 1485.516281] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.737633] env[66834]: INFO networking_nsxv3.common.synchronization [None req-a00218af-c218-4aad-82ec-417632c36cf5 tempest-AttachVolumeTestJSON-1058476096 tempest-AttachVolumeTestJSON-1058476096-project-member] Enqueued Resource ID: cced9b3e-a1b3-4714-80f6-6c75d5058796 with Priority: HIGHEST for action security_group_rules [ 1487.738192] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cced9b3e-a1b3-4714-80f6-6c75d5058796 with Priority: HIGHEST for action security_group_rules [ 1487.738537] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cced9b3e-a1b3-4714-80f6-6c75d5058796 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.738697] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.738760] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.739044] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.739138] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cced9b3e-a1b3-4714-80f6-6c75d5058796',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1487.831116] env[66834]: INFO networking_nsxv3.common.synchronization [None req-b7059b8c-1c69-4f60-af1f-7c2de382ded5 tempest-AttachVolumeTestJSON-1058476096 tempest-AttachVolumeTestJSON-1058476096-project-member] Enqueued Resource ID: cced9b3e-a1b3-4714-80f6-6c75d5058796 with Priority: HIGHEST for action security_group_rules [ 1487.831580] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cced9b3e-a1b3-4714-80f6-6c75d5058796 with Priority: HIGHEST for action security_group_rules [ 1487.831874] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cced9b3e-a1b3-4714-80f6-6c75d5058796 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.831977] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.165891] env[66834]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1488.166045] env[66834]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-478883e8-69d2-496a-b0cc-b12c2d430b0b None None] NSXv3 Agent Agent loop - iteration:4 started [ 1488.261502] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.261754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.261851] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.262106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.262251] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.262398] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cced9b3e-a1b3-4714-80f6-6c75d5058796 already deleted. [ 1488.262533] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.262727] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.262940] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.263081] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cced9b3e-a1b3-4714-80f6-6c75d5058796',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.784158] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.784554] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.784554] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.784554] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.784675] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.784734] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cced9b3e-a1b3-4714-80f6-6c75d5058796 already deleted. [ 1488.784857] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1492.832809] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1492.833267] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1493.213026] env[66834]: INFO networking_nsxv3.common.synchronization [req-5f6e9c43-4294-4ed8-a0a8-c816dab949b3 req-b7d7469c-af1e-41e8-b925-43837b6dde41 tempest-AttachVolumeTestJSON-1058476096 tempest-AttachVolumeTestJSON-1058476096-project-member] Enqueued Resource ID: cced9b3e-a1b3-4714-80f6-6c75d5058796 with Priority: HIGHEST for action security_group_members [ 1493.213341] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cced9b3e-a1b3-4714-80f6-6c75d5058796 with Priority: HIGHEST for action security_group_members [ 1493.213425] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-cced9b3e-a1b3-4714-80f6-6c75d5058796 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.213515] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.213580] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.213826] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.213976] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.214103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.214158] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.214316] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.214684] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.214684] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cced9b3e-a1b3-4714-80f6-6c75d5058796',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1493.512330] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock network-334 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.512520] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "network-334" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.512640] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "network-334" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.512908] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "network-334" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.513173] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.513328] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.513441] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.513649] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.513786] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.513983] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1493.514106] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] NeedRegenerationException {{(pid=66834) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1493.514232] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] no value, waiting for create lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1493.514343] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] value creation lock acquired {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1493.514450] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] No value present for key: 'zone-id' {{(pid=66834) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1493.514551] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Calling creation function for not-yet-present value {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1493.514676] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1493.535318] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1493.535471] env[66834]: DEBUG dogpile.cache.region [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66834) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1493.535594] env[66834]: DEBUG dogpile.lock [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Released creation lock {{(pid=66834) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1493.535766] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "network-334" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.536073] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock port-ac5aa767-b42b-49c0-93be-89f2f0863b69 taken with stack trace [, , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.536268] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "port-ac5aa767-b42b-49c0-93be-89f2f0863b69" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.536389] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "port-ac5aa767-b42b-49c0-93be-89f2f0863b69" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.536691] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "port-ac5aa767-b42b-49c0-93be-89f2f0863b69" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.536828] env[66834]: DEBUG networking_nsxv3.api.rpc [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac5aa767-b42b-49c0-93be-89f2f0863b69',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1493.718079] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.718305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.718305] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.718486] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.718574] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.718763] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.718862] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.718924] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.719112] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.719237] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.719282] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cced9b3e-a1b3-4714-80f6-6c75d5058796 already deleted. [ 1493.719339] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.038827] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.039173] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.039289] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.039612] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.039832] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.039995] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Segment Port ac5aa767-b42b-49c0-93be-89f2f0863b69 not found, creating... [ 1494.040270] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.040471] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.040618] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.040855] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.041027] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.041341] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.041540] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.041683] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.041983] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.042169] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.042339] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Resource: SegmentPort with ID: ac5aa767-b42b-49c0-93be-89f2f0863b69 is going to be created. [ 1494.063122] env[66834]: DEBUG networking_nsxv3.common.locking [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.063324] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.063529] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.063833] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.064149] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.064444] env[66834]: DEBUG oslo_concurrency.lockutils [None req-08445cf1-505e-48f1-aa05-e30b656d70ac None None] Releasing lock "port-ac5aa767-b42b-49c0-93be-89f2f0863b69" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.758074] env[66834]: INFO networking_nsxv3.common.synchronization [req-5f6e9c43-4294-4ed8-a0a8-c816dab949b3 req-a2bd5b94-4daa-49ab-a781-01fba301e9a0 service nova] Enqueued Resource ID: cced9b3e-a1b3-4714-80f6-6c75d5058796 with Priority: HIGHEST for action security_group_rules [ 1494.758074] env[66834]: INFO networking_nsxv3.common.synchronization [req-5f6e9c43-4294-4ed8-a0a8-c816dab949b3 req-a2bd5b94-4daa-49ab-a781-01fba301e9a0 service nova] Enqueued Resource ID: cced9b3e-a1b3-4714-80f6-6c75d5058796 with Priority: HIGHEST for action security_group_members [ 1494.758074] env[66834]: INFO networking_nsxv3.common.synchronization [req-5f6e9c43-4294-4ed8-a0a8-c816dab949b3 req-a2bd5b94-4daa-49ab-a781-01fba301e9a0 service nova] Enqueued Resource ID: ac5aa767-b42b-49c0-93be-89f2f0863b69 with Priority: HIGHEST for action port [ 1494.758074] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cced9b3e-a1b3-4714-80f6-6c75d5058796 with Priority: HIGHEST for action security_group_rules [ 1494.758074] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cced9b3e-a1b3-4714-80f6-6c75d5058796 with Priority: HIGHEST for action security_group_members [ 1494.758074] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac5aa767-b42b-49c0-93be-89f2f0863b69 with Priority: HIGHEST for action port [ 1494.758074] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cced9b3e-a1b3-4714-80f6-6c75d5058796 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.758074] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.758074] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.758074] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.758582] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cced9b3e-a1b3-4714-80f6-6c75d5058796',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1494.759642] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-cced9b3e-a1b3-4714-80f6-6c75d5058796 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.759878] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.760044] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.760313] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.760559] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.760852] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.761014] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.761253] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.761660] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.761907] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cced9b3e-a1b3-4714-80f6-6c75d5058796',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1494.762794] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac5aa767-b42b-49c0-93be-89f2f0863b69 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.763467] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac5aa767-b42b-49c0-93be-89f2f0863b69" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.765107] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac5aa767-b42b-49c0-93be-89f2f0863b69" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.765107] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac5aa767-b42b-49c0-93be-89f2f0863b69" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.765107] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac5aa767-b42b-49c0-93be-89f2f0863b69',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.265869] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cced9b3e-a1b3-4714-80f6-6c75d5058796',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.267266] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-cced9b3e-a1b3-4714-80f6-6c75d5058796 taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.267418] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.267655] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac5aa767-b42b-49c0-93be-89f2f0863b69 with status ACTIVE [ 1495.267883] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.268059] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.268163] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.268411] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.268525] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.268671] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.268762] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.268860] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.268964] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.269060] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.269245] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.269372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.269495] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.269682] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.269776] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.269863] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac5aa767-b42b-49c0-93be-89f2f0863b69 is going to be updated. [ 1495.292952] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.293193] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.293193] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.293370] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.293497] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.293659] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac5aa767-b42b-49c0-93be-89f2f0863b69" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.772081] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cced9b3e-a1b3-4714-80f6-6c75d5058796',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1496.111506] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.111738] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.111738] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.111949] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.112077] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1496.274087] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.274499] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.274499] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.274499] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.274632] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.274711] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cced9b3e-a1b3-4714-80f6-6c75d5058796 is going to be created. [ 1496.296682] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.296890] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.296890] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.297123] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.297297] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.306572] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cced9b3e-a1b3-4714-80f6-6c75d5058796 in Status: UNINITIALIZED for 2s [ 1496.614278] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1497.116577] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1497.618919] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1497.619339] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1498.322223] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cced9b3e-a1b3-4714-80f6-6c75d5058796 in Status: SUCCESS [ 1498.322404] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.322571] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.322791] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.322977] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.323131] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.323209] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.323375] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.323496] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.323675] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.323781] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cced9b3e-a1b3-4714-80f6-6c75d5058796',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1498.420504] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.420683] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.420753] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.420923] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.432696] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1498.433613] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.434761] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1498.611561] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.611788] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.611788] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.612082] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.626883] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.627909] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1498.628025] env[66834]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66834) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1498.628133] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1498.662057] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.662330] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.662330] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.662539] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.663372] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.663551] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1498.739058] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.739248] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.739312] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.739483] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.739786] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.740066] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1498.822601] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.822952] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.822952] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.823168] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.823492] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.823793] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:28. [ 1498.823885] env[66834]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'4cdb75fc-c0b5-4b9d-843f-f2ae58af6997', '87920817-9bc0-40b2-945a-8057b5158162', '06251551-417e-4f8a-9412-fdb5036f57fe', '0750b6a7-8358-4db0-b46f-3ccbf925625d', 'a4da628c-f2f0-417c-917f-a8cc4350870b', '50181de0-6504-4170-88de-c63c6b1ec2d0', 'c40be9d7-369b-4cf1-88e7-d822d62fa7f1', '98a1f729-8e05-4426-8db7-2c883443f0e8', '8ef26513-917e-4754-b69d-1d511bcb585b', 'bf09a47e-d4ed-48d3-bd2e-95954524a76b', '1e596c06-a8da-4399-84d9-6ac9ccab328a', '52cb0804-8dc9-431c-b223-368ab8a8eb18', 'b2373999-4b09-4e6b-b917-d763ef04d09e', '7b33fa48-b9ca-426c-b890-67d4639035e2', '849b7083-c8aa-4040-9084-38d57e44aa72', 'd988bd9b-01f8-4a05-afd2-00c938df4bec', 'df231fd1-d2d8-4abc-b6ff-458d22e07e4e', '659c3ecb-b49f-4d7f-8978-4e0221530e96', '6b93eb01-51cc-4c25-b2fa-56b4a62620d3', '06c1d39f-c76e-47c4-9900-046863c4e37a', 'aae6a6e9-1f82-4e25-9279-c0d1c3b5b593', 'f46326b4-7843-4c05-8eca-cb73edd99c30', '61dc46c7-365b-480f-83e5-16cbc578a879', 'e2adc0e3-5bbc-44c6-8c57-a7c33c081f9c', '4c24c1b0-fd8f-4bea-ac50-4b80d0d005e4', '7963c125-23b5-45fd-8158-f6470d12949e', '673eef00-b174-4a71-a870-466f27b577fd', 'eb96d654-f9e7-43ce-b22e-df261ce3be7f'} {{(pid=66834) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1498.824030] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1498.825517] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cced9b3e-a1b3-4714-80f6-6c75d5058796',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1498.846027] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.846269] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.846269] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.846510] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.846510] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.846626] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1498.846675] env[66834]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66834) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1498.846746] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1498.931341] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.933483] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.933483] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.933483] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.933483] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.933483] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1498.933483] env[66834]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66834) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1498.933870] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1498.933870] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1498.933870] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/28 resources of Type:Security Group Rules [ 1498.933870] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGH for action security_group_rules [ 1498.933870] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 87920817-9bc0-40b2-945a-8057b5158162 with Priority: HIGH for action security_group_rules [ 1498.933870] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGH for action security_group_rules [ 1498.934214] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d with Priority: HIGH for action security_group_rules [ 1498.934214] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a4da628c-f2f0-417c-917f-a8cc4350870b with Priority: HIGH for action security_group_rules [ 1498.934214] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 50181de0-6504-4170-88de-c63c6b1ec2d0 with Priority: HIGH for action security_group_rules [ 1498.934214] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 with Priority: HIGH for action security_group_rules [ 1498.934214] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 98a1f729-8e05-4426-8db7-2c883443f0e8 with Priority: HIGH for action security_group_rules [ 1498.934214] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8ef26513-917e-4754-b69d-1d511bcb585b with Priority: HIGH for action security_group_rules [ 1498.934463] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b with Priority: HIGH for action security_group_rules [ 1498.934463] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a with Priority: HIGH for action security_group_rules [ 1498.934463] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 with Priority: HIGH for action security_group_rules [ 1498.934463] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b2373999-4b09-4e6b-b917-d763ef04d09e with Priority: HIGH for action security_group_rules [ 1498.934661] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGH for action security_group_rules [ 1498.934661] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 849b7083-c8aa-4040-9084-38d57e44aa72 with Priority: HIGH for action security_group_rules [ 1498.934661] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d988bd9b-01f8-4a05-afd2-00c938df4bec with Priority: HIGH for action security_group_rules [ 1498.934661] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e with Priority: HIGH for action security_group_rules [ 1498.934829] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 659c3ecb-b49f-4d7f-8978-4e0221530e96 with Priority: HIGH for action security_group_rules [ 1498.934829] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 with Priority: HIGH for action security_group_rules [ 1498.934829] env[66834]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06c1d39f-c76e-47c4-9900-046863c4e37a with Priority: HIGH for action security_group_rules [ 1498.934944] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.328365] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cced9b3e-a1b3-4714-80f6-6c75d5058796: rpc.has_security_group_logging(os_id): False [ 1499.345848] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.346103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.346103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.346282] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.346364] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.346609] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.346712] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.346772] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.346919] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.346991] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.347087] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cced9b3e-a1b3-4714-80f6-6c75d5058796 is going to be created. [ 1499.406863] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.407124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.407124] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.407298] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.407480] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.422574] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cced9b3e-a1b3-4714-80f6-6c75d5058796 in Status: IN_PROGRESS for 2s [ 1499.758656] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1499.759077] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=1 [ 1499.759077] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 with Priority: HIGH for action security_group_rules [ 1499.759077] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06251551-417e-4f8a-9412-fdb5036f57fe with Priority: HIGH for action security_group_rules [ 1499.759204] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 with Priority: HIGH for action security_group_rules [ 1499.759296] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 849b7083-c8aa-4040-9084-38d57e44aa72 with Priority: HIGH for action security_group_rules [ 1499.759417] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06c1d39f-c76e-47c4-9900-046863c4e37a with Priority: HIGH for action security_group_rules [ 1499.759534] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 with Priority: HIGH for action security_group_rules [ 1499.759734] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 659c3ecb-b49f-4d7f-8978-4e0221530e96 with Priority: HIGH for action security_group_rules [ 1499.759825] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e with Priority: HIGH for action security_group_rules [ 1499.759862] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 with Priority: HIGH for action security_group_rules [ 1499.759934] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d988bd9b-01f8-4a05-afd2-00c938df4bec with Priority: HIGH for action security_group_rules [ 1499.760033] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2373999-4b09-4e6b-b917-d763ef04d09e with Priority: HIGH for action security_group_rules [ 1499.760139] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 with Priority: HIGH for action security_group_rules [ 1499.760280] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a with Priority: HIGH for action security_group_rules [ 1499.760349] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b with Priority: HIGH for action security_group_rules [ 1499.760451] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ef26513-917e-4754-b69d-1d511bcb585b with Priority: HIGH for action security_group_rules [ 1499.760563] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50181de0-6504-4170-88de-c63c6b1ec2d0 with Priority: HIGH for action security_group_rules [ 1499.760686] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98a1f729-8e05-4426-8db7-2c883443f0e8 with Priority: HIGH for action security_group_rules [ 1499.760740] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4da628c-f2f0-417c-917f-a8cc4350870b with Priority: HIGH for action security_group_rules [ 1499.760843] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87920817-9bc0-40b2-945a-8057b5158162 with Priority: HIGH for action security_group_rules [ 1499.760939] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d with Priority: HIGH for action security_group_rules [ 1499.761355] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.761508] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.761592] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.761820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.761918] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cdb75fc-c0b5-4b9d-843f-f2ae58af6997',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.763389] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06251551-417e-4f8a-9412-fdb5036f57fe taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.763500] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.763569] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.763763] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.763854] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06251551-417e-4f8a-9412-fdb5036f57fe',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.764703] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c40be9d7-369b-4cf1-88e7-d822d62fa7f1 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.764825] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.764904] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.765103] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.765401] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c40be9d7-369b-4cf1-88e7-d822d62fa7f1',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.765830] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-849b7083-c8aa-4040-9084-38d57e44aa72 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.765938] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.766020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.766162] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.766239] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('849b7083-c8aa-4040-9084-38d57e44aa72',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.766912] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06c1d39f-c76e-47c4-9900-046863c4e37a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.767036] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.767100] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.767259] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.767366] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06c1d39f-c76e-47c4-9900-046863c4e37a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.768079] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b93eb01-51cc-4c25-b2fa-56b4a62620d3 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.768178] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.768239] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.768406] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.768485] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b93eb01-51cc-4c25-b2fa-56b4a62620d3',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.769110] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-659c3ecb-b49f-4d7f-8978-4e0221530e96 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.769227] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.769289] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.769436] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.769504] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('659c3ecb-b49f-4d7f-8978-4e0221530e96',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.770278] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df231fd1-d2d8-4abc-b6ff-458d22e07e4e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.770278] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.770388] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.770471] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.770533] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df231fd1-d2d8-4abc-b6ff-458d22e07e4e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.771314] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b33fa48-b9ca-426c-b890-67d4639035e2 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.771431] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.771431] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.771565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.771628] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b33fa48-b9ca-426c-b890-67d4639035e2',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.772294] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d988bd9b-01f8-4a05-afd2-00c938df4bec taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.772386] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.772455] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.772600] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.772671] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d988bd9b-01f8-4a05-afd2-00c938df4bec',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.773368] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2373999-4b09-4e6b-b917-d763ef04d09e taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.773507] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.773507] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.773621] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.773687] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2373999-4b09-4e6b-b917-d763ef04d09e',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.774430] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52cb0804-8dc9-431c-b223-368ab8a8eb18 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.774533] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.774579] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.774728] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.774804] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52cb0804-8dc9-431c-b223-368ab8a8eb18',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.775492] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e596c06-a8da-4399-84d9-6ac9ccab328a taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.775602] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.775602] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.775752] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.775823] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e596c06-a8da-4399-84d9-6ac9ccab328a',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.776539] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf09a47e-d4ed-48d3-bd2e-95954524a76b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.776652] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.776751] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.776889] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.776965] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf09a47e-d4ed-48d3-bd2e-95954524a76b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.777767] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ef26513-917e-4754-b69d-1d511bcb585b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.777930] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.777930] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.778086] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.778157] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ef26513-917e-4754-b69d-1d511bcb585b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.778846] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50181de0-6504-4170-88de-c63c6b1ec2d0 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.778952] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.779026] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.779200] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.779278] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50181de0-6504-4170-88de-c63c6b1ec2d0',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.779979] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98a1f729-8e05-4426-8db7-2c883443f0e8 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.780110] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.780177] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.780333] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.780405] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98a1f729-8e05-4426-8db7-2c883443f0e8',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.781149] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4da628c-f2f0-417c-917f-a8cc4350870b taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.781263] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.781315] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.781455] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.781552] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4da628c-f2f0-417c-917f-a8cc4350870b',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.782205] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87920817-9bc0-40b2-945a-8057b5158162 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.782311] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.782392] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.782565] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.782638] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87920817-9bc0-40b2-945a-8057b5158162',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.783326] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0750b6a7-8358-4db0-b46f-3ccbf925625d taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.783639] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.783639] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.783639] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.783773] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0750b6a7-8358-4db0-b46f-3ccbf925625d',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.817914] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.818076] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.818138] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.818771] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.820413] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.820511] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.823879] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.823973] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.829966] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.830130] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.830912] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.831012] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.831700] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.831794] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.832594] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.832683] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.838839] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.838940] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cdb75fc-c0b5-4b9d-843f-f2ae58af6997 is going to be deleted. [ 1499.839815] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.840010] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.857077] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.857220] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b93eb01-51cc-4c25-b2fa-56b4a62620d3 is going to be deleted. [ 1499.858108] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.858383] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.878202] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.878386] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c40be9d7-369b-4cf1-88e7-d822d62fa7f1 is going to be deleted. [ 1499.879211] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.879448] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.899715] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.900050] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.903105] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.903317] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06251551-417e-4f8a-9412-fdb5036f57fe is going to be deleted. [ 1499.904477] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.904725] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.906548] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.906675] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.926329] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.926553] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.941212] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.941408] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 659c3ecb-b49f-4d7f-8978-4e0221530e96 is going to be deleted. [ 1499.942513] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.942868] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.043355] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.043536] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06c1d39f-c76e-47c4-9900-046863c4e37a is going to be deleted. [ 1500.044374] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.044600] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.061289] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.061533] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.108060] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.108247] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 849b7083-c8aa-4040-9084-38d57e44aa72 is going to be deleted. [ 1500.109161] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.109378] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.109468] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.109586] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cdb75fc-c0b5-4b9d-843f-f2ae58af6997" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.109743] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.109891] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.109968] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.110090] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b93eb01-51cc-4c25-b2fa-56b4a62620d3" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.110579] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.110738] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.110838] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.110942] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c40be9d7-369b-4cf1-88e7-d822d62fa7f1" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.111694] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.111801] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.111865] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.112024] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.112105] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.112206] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-659c3ecb-b49f-4d7f-8978-4e0221530e96" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.112317] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.112457] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.112531] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.112634] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06251551-417e-4f8a-9412-fdb5036f57fe" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.170434] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.170689] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.170820] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.171162] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.171328] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.171536] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06c1d39f-c76e-47c4-9900-046863c4e37a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.283349] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.283573] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.283573] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.283772] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.283861] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.283984] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-849b7083-c8aa-4040-9084-38d57e44aa72" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.340082] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.340353] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.340353] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.340497] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.342224] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.342346] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.342978] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.343105] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.343813] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.343932] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.344595] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.344719] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.345412] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.345532] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.346287] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.346409] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.347128] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.347249] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.347930] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.348055] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.348701] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.348818] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.349533] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.349657] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.350242] env[66834]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1500.350721] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.350838] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.351797] env[66834]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1500.352213] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.352327] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.387876] env[66834]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1500.388487] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.388639] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d988bd9b-01f8-4a05-afd2-00c938df4bec is going to be deleted. [ 1500.389643] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.389851] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.440080] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.440080] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0750b6a7-8358-4db0-b46f-3ccbf925625d is going to be deleted. [ 1500.440864] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.441087] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.462017] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.462239] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.466673] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.466823] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df231fd1-d2d8-4abc-b6ff-458d22e07e4e is going to be deleted. [ 1500.467698] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.467904] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.503140] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.503360] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.504545] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.504665] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e596c06-a8da-4399-84d9-6ac9ccab328a is going to be deleted. [ 1500.505534] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.505735] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.552729] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.552885] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.554083] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.554226] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf09a47e-d4ed-48d3-bd2e-95954524a76b is going to be deleted. [ 1500.555097] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.555306] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.590998] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.591157] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.596434] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.596434] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52cb0804-8dc9-431c-b223-368ab8a8eb18 is going to be deleted. [ 1500.596434] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.596434] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.616948] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.617169] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ef26513-917e-4754-b69d-1d511bcb585b is going to be deleted. [ 1500.617980] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.618191] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.670589] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.670770] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.671460] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.671556] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.685182] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.685364] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2373999-4b09-4e6b-b917-d763ef04d09e is going to be deleted. [ 1500.686281] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.686497] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.726834] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.727045] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98a1f729-8e05-4426-8db7-2c883443f0e8 is going to be deleted. [ 1500.728052] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.728295] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.730947] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.731160] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.759429] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.759824] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.763550] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.763701] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50181de0-6504-4170-88de-c63c6b1ec2d0 is going to be deleted. [ 1500.764595] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.764801] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.803422] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.803633] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b33fa48-b9ca-426c-b890-67d4639035e2 is going to be deleted. [ 1500.804494] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.804713] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.897688] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.897960] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.898757] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.898879] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87920817-9bc0-40b2-945a-8057b5158162 is going to be deleted. [ 1500.900220] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.900321] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.900393] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.900592] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.900675] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.900790] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50181de0-6504-4170-88de-c63c6b1ec2d0" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.901031] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.901092] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.954926] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.955114] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4da628c-f2f0-417c-917f-a8cc4350870b is going to be deleted. [ 1500.956190] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.956460] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.956570] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.956712] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0750b6a7-8358-4db0-b46f-3ccbf925625d" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.956903] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.957106] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.957205] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.957344] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df231fd1-d2d8-4abc-b6ff-458d22e07e4e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.957928] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.958149] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.958230] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.958377] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e596c06-a8da-4399-84d9-6ac9ccab328a" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.958576] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.958716] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.958810] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.958944] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52cb0804-8dc9-431c-b223-368ab8a8eb18" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.959104] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.959274] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.959362] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.959491] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf09a47e-d4ed-48d3-bd2e-95954524a76b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.959644] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.959815] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.959922] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.960066] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ef26513-917e-4754-b69d-1d511bcb585b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.960197] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.960374] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.960464] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.960596] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2373999-4b09-4e6b-b917-d763ef04d09e" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.960748] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.960916] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.961017] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.961155] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98a1f729-8e05-4426-8db7-2c883443f0e8" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.961302] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.961467] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.961557] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.961684] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d988bd9b-01f8-4a05-afd2-00c938df4bec" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.002648] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.002876] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.002876] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.003096] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.003190] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.003311] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b33fa48-b9ca-426c-b890-67d4639035e2" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.038985] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.039221] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.039221] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.039430] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.039532] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.039657] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87920817-9bc0-40b2-945a-8057b5158162" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.093748] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.094020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.094020] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.094292] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.094398] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.094524] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4da628c-f2f0-417c-917f-a8cc4350870b" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.435554] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cced9b3e-a1b3-4714-80f6-6c75d5058796 in Status: SUCCESS [ 1501.435793] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.762662] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1504.763042] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1509.764426] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1509.764805] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1514.766216] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1514.766678] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1519.767721] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1519.768169] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1524.769058] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1524.769449] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1529.770363] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1529.770798] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1534.771289] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1534.771677] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1539.772913] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1539.773323] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1544.773989] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1544.773989] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1549.774903] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1549.775343] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1554.775968] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1554.775968] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1559.777333] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1559.777724] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1564.778584] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1564.778584] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1569.779659] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1569.779659] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1571.962538] env[66834]: INFO networking_nsxv3.common.synchronization [req-1892f8f8-bf22-41ea-a418-d8cd6f18ae1f req-bdbd0205-5514-4ed5-a94f-acf143b0c362 tempest-AttachVolumeTestJSON-1058476096 tempest-AttachVolumeTestJSON-1058476096-project-member] Enqueued Resource ID: cced9b3e-a1b3-4714-80f6-6c75d5058796 with Priority: HIGHEST for action security_group_members [ 1571.963215] env[66834]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cced9b3e-a1b3-4714-80f6-6c75d5058796 with Priority: HIGHEST for action security_group_members [ 1571.963931] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock member-cced9b3e-a1b3-4714-80f6-6c75d5058796 taken with stack trace [, , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.963931] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.963931] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.963931] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.964192] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.964299] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.964343] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.964508] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.964622] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.964777] env[66834]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cced9b3e-a1b3-4714-80f6-6c75d5058796',) {} {{(pid=66834) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1572.467504] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.467771] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.467771] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.467998] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.468145] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1572.468353] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.468456] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.468518] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.468680] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.468754] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1572.468842] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cced9b3e-a1b3-4714-80f6-6c75d5058796 is going to be updated. [ 1572.506545] env[66834]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66834) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.506759] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.506759] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.506930] env[66834]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.507088] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1572.514847] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cced9b3e-a1b3-4714-80f6-6c75d5058796 in Status: IN_PROGRESS for 2s [ 1574.525817] env[66834]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cced9b3e-a1b3-4714-80f6-6c75d5058796 in Status: SUCCESS [ 1574.526206] env[66834]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cced9b3e-a1b3-4714-80f6-6c75d5058796 deletion is rescheduled due to dependency. [ 1574.526206] env[66834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cced9b3e-a1b3-4714-80f6-6c75d5058796" {{(pid=66834) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1576.963715] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1576.964131] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1581.965095] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1581.965095] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1586.966405] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1586.966661] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1591.967442] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1591.967855] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1596.969058] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1596.969422] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1601.970121] env[66834]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1601.970574] env[66834]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0